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ABSTRACT 


Failing software development projects are plaguing the Department of Defense and 
other Federal service agencies today. Compounding this fact, the complexity of today's 
software projects makes it extremely difficult to isolate the underlying problem areas. The 
System Dynamic Model (SDM), a quantitative tool that simulates software development 
life cycles, enables us to investigate these problem areas as well as many other pertinent 
areas. It allows the isolation and manipulation of management variables allowing analysis 
which in turn leads to a better understanding of the effects variables have on projects. 
This thereby presents an opportunity to suggest solutions. 

This thesis uses this System Dynamic Model's gaming interface to investigate the 
effects of time delays an software project management. Specifically, this experiment 
focuses on how software project managers compensate for assimilation and hiring delays 
inherent to a single project environment. The effect of these delays are measured in terms 


of staffing level decisions, final cost, and project completion. 
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I. INTRODUCTION 


A. BACKGROUND 


Within the Department of Defense (DOD), as well as many other Federal service 
agencies, a critical problem exists concerning software development and management. 
Software projects that are over budget and behind schedule are commonplace and it seems 
conceivable that this trend will continue if we do not determine the causes and strive to 
resolve them. Managers of these projects are continuously blamed for the failure, but 
seldom given direction to correct the situation. 

Two of the most crucial project components the project manager is concerned with 
are people and money. The various idiosyncrasies of people and the constant flux in 
project budgets cause difficult problems for the manager who always needs more people 
than his money can buy. 

What then can we do to help these managers come to grips with this problem? 
One focus 1s to break apart the various decision areas the manager is involved with and 
analyze the various options. Through this evaluation, perhaps we might isolate and better 
understand each area and provide managers with the proper direction they should follow 
or at least clear up the gray areas to clarify their role. 

A comprehensive simulation model that addresses the dynamics of software 
development has been developed at the Naval Postgraduate School [Ref. 1] and provides a 
platform for experimentation. This Systems Dynamics Model (SDM) allows the 


manipulation of one or several factors while holding others constant so we may study the 


decision making process in segments. Through the simulation of software project 
management scenarios, we are able to isolate several decision processes concerning 
scheduling, staffing and productivity. These results then can be analyzed to see what 
impact the decisions had on the project. 

One area of research to be studied is that of staffing decisions. Project managers 
are continuously faced with difficult manning decisions that seriously affect the project's 
schedule and budget. Within this staffing area, managers are faced with delays in hiring 
and assimilating personnel into the project and often make the decision to hire late in the 
life cycle to bring the project to a successful completion. The problem of such late hiring 
has been stated clearly in Brooks Law: "Adding people to a late project makes it later" 
(Ref. 1]. 

Through the analysis of various management scenarios we can focus on what 
information managers use to make different staffing decisions. By comparing projects with 
different time delay periods we can better understand where the decision process 
concerning late staffing gets derailed. 


B. PURPOSE OF RESEARCH 


The purpose of this thesis is to design, develop, and then execute an experiment 
using a single project management environment using the Systems Dynamic Model (SDM) 
gaming interface. The objective of the experiment is to examine the effects of assimilation 
and hiring delays on managerial staffing decisions. Even though research has been 


conducted into the affects of delays on decision making [Ref. 2] , no study on the effects 


of delays on staffing software projects using this type of tool has been performed and 
analyzed. 


on SCOPE OF RESEARCH 


The scope of this research is the design, construction, and execution of the systems 
dynamic model/gaming interface using a single project environment that has been 
specifically designed to isolate the staffing variable. A group of experimental subjects was 
divided into four groups (A-D) working on the exact same simulated project. The only 
differences among the groups were varying assimilation and hiring delay time periods that 
was described in the documentation provided to each group. Great care was taken to 
insure that each of the four tested groups were administered the exact same project to 
manage, and to insure that each participant had no idea of what the other participants were 
working on. 


D. LIMITATIONS 


The participants studied for this experiment were graduate students in their fifth 
quarter of an eight quarter preparation, graduate and subspecialty education program 
leading to a MS degree in Information Technology Management at the Naval Postgraduate 
School in Monterey, California. Although these students were not in fact software project 
managers, the amount of education in software project management and related subjects 
provided thus far in their curriculum, coupled with general management experience in their 


careers, suggests that they are appropriate surrogates for real life software managers. This 


is further supported by findings of Williams Remus in his research of using graduate 
students for experimental studies [Ref. 3]. 


E. THESIS ORGANIZATION 


Chapter II is an in-depth description of the experiment's organization, its 
methodology, and experimental group. Chapter III describes the various software files 
and the design of the documentation, as well as the construction considerations taken into 
account during the creation of the experiment. The chapter also covers the trial experiment 
and outcomes. Chapter IV analyzes the results and validates the findings. Chapter V is a 
summery of the prominent accomplishments and findings presented in chapters II-IV as 


well as suggestions for further research. 


II. PREPARATION OF GAME INTERFACE 
A. EXPERIMENTAL DESIGN 

Just like a flight simulator aids a pilot in simulating flight environments, the 
Systems Dynamic Model (SDM) aids in simulating the life of a real software project for 
software project managers. The model simulates a software development project 
environment beginning with the "Design" phase and ending with the completion of the 
"Testing" phase. 

For this experiment, a single research question was isolated for examination: Do 
software project managers compensate for hiring delays and/or assimilation delays in their 
staffing decisions? The experiment focuses on how managers handle the hiring and 
assimilation delays inherent to their particular projects, and how the decisions they make 
concerning these delays are reflected in their staffing decisions. 

In the experiment, participants assume the role of software project managers. 
They are tasked to use information, gleaned from reports generated by the model every 
two calendar months (forty working days), in conjunction with their knowledge of the 
hiring and assimilation delays inherent to their project, to update the project's staffing 
level. They can either: 1) increase the staff level, essentially hiring personnel; or 2) 
decrease the staff level, essentially firing personnel; or 3) do neither by maintaining their 
current staff level. The overall goal for each manager 1s to complete the project on 


schedule and within budget. A sample report is illustrated in Figure 2-1. 


CURRENT INTERVAL STATISTICS: Elapsed Time= 40 
INITIAL ESTIMATES: (These will not change throughout the project) 


Project Size 397 Tasks 
Project Cost _ 1,111 Person-Days 
Project Duration 320 Days 
REPORTED STATISTICS at Time======> 40 Days 
Updated Estimate of Total Project Size QO Tasks 

% Development Reported Complete 45 Percent 
Total Person Days Expended to-date 684 Person Days 
New Est of Project Duration (start-end) 285 Days 

Time Remaining 280 Days 
Current Staff Size 5.00 People 
Percent of Workforce that is Experienced 70 ~=Percent 





PRESS <ENTER> TO VIEW THE GRAPHICALLY DISPLAYED VARIABLES 


Figure 2-1 Sample report, generated every 40 working days 


To compare the varying managerial decisions, each participant was assigned 


randomly to one of four groups (A-D). Each group was in turn assigned different 


assimilation and hiring delays. Figure 2-2 illustrates these delays. 


DELAYS BY GROUP (IN DAYS) 


| ~BASSIM 


HIRING 


DAYS 





PROJECT 


Figure 2-2 Assimilation and Hiring delay differences by Group 


The actual names assigned for this experiment were: Projecta, Projectb, Proyectc, and 
Projectd. As illustrated in figure 2-2, Group A was assigned maximum assimilation and 
hiring delays (80 days for assimilation, 60 days for hiring), group B_ maximum assimilation 
delay only (80 days for assimilation, 12 days for hiring), group C maximum hiring delays 
only (9 days for assimilation, 60 days for hiring), and Group D minimal hiring and 
assimilation delays (9 days for assimilation, 12 days for hiring). 

Throughout this chapter, the symbol ? will be used to identify generic file reference 
to the four projects, (i.e. Project?.BAT). This experiment was created using data 
collected from a real NASA project. This is advantageous in that it allows for 
measurement and comparison against a known baseline. 

Each participant was provided a folder with documentation pertaining to his/her 
randomly assigned group and a disk containing the group's software. The independent 
variables were the hiring and assimilation delays described in the documentation provided 
within each folder. The dependent variables were the staff level, project cost, and 
completion time. These folders are discussed later in the chapter as well. 

All participants had prior experience with the SDM interface in a previous course 
in a slightly different context. To ensure that they were comfortable with the simulation, a 
Sample report was provided along with a 30 minute review of project management. The 
participants were also told that a "TEST" run would be accomplished by each participant 


just prior to the actual simulation. This simulation, called "TEST", and it's 


documentation, mirrored the experiment simulation with the exception of the default staff 
level and project duration. 

Participants were not paid monetarily, but were told that they would be assigned a 
grade based on their performance. This was to insure that they would be serious and 
diligent in their participation. Disclosure of experiment specifics was held until the day of 
the experiment so as to better control the knowledge base of the participants. 


B. THE SOFTWARE 


There were two primary efforts in the design of the experiment's software; the 
software interface, and the instructions for its use. Much care was taken to ensure the 
interface was both easy to use and clear in it's purpose. For each screen, detailed written 
and on screen documentation was provided to ensure total comprehension of the 
environment. The purpose of this was to ensure that the participants were capable of 
using the interface without having to worry about how the simulation works. 

1. Software Interface 

The SDM software includes the DYN simulator as well as DYNEX files which 
help model the interface. The DYNEX file, Pro}?.DNX, provides three primary 
functions: |) it displays information on the screen to the participant; 2) it captures the staff 
variable input; and 3) it provides an output format for the simulations reports. A copy 
of the DYNEX file is provided in appendix A. 

The DYNEX file works directly with the Project?.BAT batch file. This batch file 


is the primary control file for the entire user interface, and is common to each group 


project. This file directs a basic set of files that inter-operate and control the whole 


simulation. Figure 2-3 illustrates the overall architecture. 


PROJ?. DNX 


9 
PROJ?.DAT INIT. EXE 


PROJ?. SMT 
Ov ORS 


PROJ?.DRS 





Figure 2-3 Flowchart of basic set of project files 
The Project?,BAT | invokes the interface, prompts the DYNEX file to provide 


instructions during each simulation, and controls the display of the status reports as well as 
the initiation of the next set of inputs. A copy of this batch file is provided in appendix B. 

Paramount to the design process was the ability to capture data to files for later 
analysis. This was done using various .OUT files each feeding or storing information as 
needed. These OUT files greatly enhanced later analysis in that they worked collectively 
to capture critical variable data, especially the staff level (WFS), input by the participant 
into a cumulative file called INFO for each participant. Figure 2-4 illustrates the INFO file 
for one participant. These INFO files were later combined for all participants for analysis. 
As illustrated in this figure, eighteen variables were captured using the various .OUT files 


and input into appropriate columns. The numerical data in this figure was excerpted from 


a single participants file, however, the column names were added to identify each variable 
captured. Definitions of these variables can be found in the variable initialization portion 


of the SAS Control file in appendix M. 


Q00 347 347 347 3 47 000 000 000 39650 000 000 32000 32000 100 00 
4000 502 539 5 39 497° 15825 1059, 9@00° 402 3604566. 15523" 230 52) 190 32 86 43 
8000 S06 S$ 33 $33 497 33234 2561 000 42421 9200 332 34 243 18 163 18 86 10 
}20)00 461 467 467 459 51331 3837 000 47605 14346 51331 58602 16602 9288 
lo0 V0 460 4660 466 457 69333 4774 000 54040 20056 693 33 31751 15751 95 71 
200 00 477 491 49] 473 87547 5704 0.00 583 43 264.07 875 47 33169 131 60 S55 
240.00 6 06 903 903 587107440 6834 000 603 36 33802 10744031565 7560 87 86 





Figure 2-4 Sample of single participants INFO file with added identifiers 


Furthermore, timestamp and capture files were included in the simulation to 
capture the time passage during each of the participants decision intervals. This 
TIMESTMP feature was transparent to the participant as they had no idea they were 
being timed on their decisions. Figure 2-5 shows these files as they are encountered 
within the Project? BAT file. This feature works in the following sequence: at the start of 
the decision cycle, when the report, shown in figure 2-1, is viewed by the participant, the 
TIMESTMP file copies the computer clock time to a temporary file, when the participant 
completes the interval, the Project?.BAT file loops back to the beginning of the reporting 
sequence (-top) and updates the simulation files with the new staff level; the CAPTURE 
file then takes the current clock time, compares it to the temporarily stored TIMESTMP 


time, and annotates the difference, in seconds, to the INFO file under the column TIME. 
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Figure 2-5 illustrates the proper placement of these two files within the Project? BAT file. 
Since the placement of the CAPTURE file needed to come before the looped TIMESTMP 
file, an initial TIMESTMP was placed before the CAPTURE file, outside the loop, to feed 
it a time, thus this time period has no bearing in the analysis. The entire .BAT file can be 


viewed in appendix B. 


echo off 
CLS 
init | 
GRAPHICS 
bat /N /p /s 
smlt PROJA -go = -prs = -ls -ns -plm 6 -bw 
rep PROJA IN : RVAL -outf INTRVAL.OUT -t -bw >NUL 
rep PROJA INTRVAL -outf INTRVL.OUT -bw >NUL 
rep PROJA -t -bw >NUL 
timestmp 


-top dynex PROJA -in PROJA.STT -sc -ls -plm 6 -bw 


smlt PROJA -gm = -ns -plm 6 -bw 
capture 
rep PROJA INTRVAL -outf INTRVAL.OUT -t -bw >NUL 
rep PROJA INTRVAL -outf INTRVL.OUT -bw >NUL 
rep PROJA -bw >NUL 
call -top1 
Exit 
goto -top%A 
-top! timestmp 
A= 1 
ram 
cls 





Figure 2-5 Excerpt form Project?.BAT file showing timestmp feature 
This time data allowed the designer to analyze decisions made over time both, 
within and between groups. This information is presented later in chapter IV. 
In all, 27 files, including the base set illustrated in figure 2-3, were needed to 


conduct the experiment. Figure 2-6 lists these necessary files. 


PROJECT?.BAT - Directly controls user interface 
TEST.BAT - Directly controls user interface for test portion 
INIT.EXE - Asks for student name and SMC box for identification 
BAT COM - Controls BAT files within simulation 

DY NEX.EXE - Allows execution of DYNEX files 
SMLT.EXE - Pinmarv DYNAMO execution file 

REP EXE - Generates specified report formats 

INFOOB.EXE - Stnps data from numerical screen inputs 
INFO - Collects all report data stripped from INFOOB.EXE 
JUNK.OUT - Feeds last report screen output to INFOOB.EXE 
INTERVAL.OUT - Contains copy of last output screen 
INTERVL.DRS - Screen report format 

PROJ?.CHG - DYNAMO generated file 

PROJ?.DAT - DYNAMO required file 

PROJ?.DNX - Project specific DYNEX file 

PROJ?.DRS - Project report file 

PROJ?.DYN - Project DYNAMO file 

PROJ? INS - DYNAMO required simulation file 

PROJ? OUT - Captures project inputs from user 

PROJ?.RSL - DYNAMO generated file 

PROJ? SMT - DYNAMO required simulation file 
PROJ?.WAS - Temp storage for input vanables 

PROJ? STT - DYNAMO generated file 

PROFXPL”.DRS - Determines vanables to be plotted 
TIME.TMP - Stores timing data generated by tumestmp.exe 
TIMESTMP.EXE - Inserts decision timing data from computers clock 
CAPTURE.EXE - Captures timing data for participant 


Figure 2-6 Project related files 

Though many variables came into play for this experiment, four primary variables 
were displayed to the participants in the reports and graphs generated by the simulation 
model. These were: (WFS) - the staff level requested by the participant; (FTEQWF) - 
the full time equivalent staff level; (FRWFEX) - the percent of the staff work force 
currently working on the project that are fully experienced; And lastly, (CMTRMD) - the 
cumulative person-days spent by experienced staff training the new staff. 

2. Software Instructions 

To aid the participants in using the software, on screen documentation was 


provided as displayed in Figure 2-7. 


KKKKKE KKK KK KK KKK KKK KEK K KEK KEKE KEKE EK KKK KX 


'!!! Important Points to Remember !!!! 
KKEKKKKEKK KEKE KEK KKK KKKKKEKEKEKEKEKE KEKE KE 


- You are not allowed to discuss this exercise with anyone 
other than a lab attendant. Please refrain from discussing 
this with members in the other class until they have completed 


the exercise. 


- The system will show you the size of the initial core team of 
software developers (the full tme equivalent number). It will 


then ask you for your initial desired staffing level. Next it 

will run through the first simulation me period and show you 
the current reported statistics. Make your change to the 

desired full time equivalent staffing level on the documentation 
sheet provided after reviewing the report. There is no need to 
turn in the documentation sheet after each interval. 

A LAB ATTENDANT MUST VERIFY YOUR FINAL RESULTS! 


- GOOD LUCK! Press <ENTER?> to continue. 





Figure 2-7 Initial screen seen by participant 


Following this introduction screen, the participant is shown the initial staffing screen as 


displayed in Figure 2-8. 


THE INITIAL CORE TEAM OF SOFTWARE 
DEVELOPERS HAS BEEN SET AT: 


3.5 Full time equivalent Personnel 


1) Press <ENTER> to keep that same 3.5 full time equivalent staff. 
OR 
2) Enter your initial desired staffing level and press <ENTER>. 





[Remember, you are working in full time equivalent personnel. | 


Figure 2-8 Initial staffing screen as viewed by participant 


This screen is the first time the participant is shown the initial staff size as provided by the 


software. 


As a follow on to the report, and as indicated at the bottom of the report screen 


in figure 2-1, a graphic display immediately followed the report plotting the report 
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information. This was a hardwired feature that intentionally could not be bypassed. Figure 
2-9 illustrates the four graphically plotted variables that were displayed on the screen and 


in the documentation to aid the participants better understand what is being displayed. 


2k 2k 2 2K ok 2K 2k akc ake 2k ok a akc ok ake ak a akc 2k ok ke ak ok ke 2K akg ake 2K akc 2k ok ake 2k ak ok akc akc ake ak 2k akc oe ok ok akc ok 2 ok ok ke ake ok akc ok ok ak ok ok ok 


GRAPHICALLY DISPLAYED VARIABLES 
THE FOLLOWING VARIABLES WILL BE PLOTTED: 


STAFF LEVEL YOU REQUESTED 

CURRENT STAFF LEVEL 

PERCENT OF STAFF THAT IS EXPERIENCED 

CUMULATIVE PERSON-DAYS SPENT ON 
TRAINING NEW STAFF 


AFTER VIEWING PLOT PRESS <ESC> TO CONTINUE 


PRESS <ENTER> TO VIEW PLOT 


26K oie 2K 2K 2c a 2 2K 2K aK a a 2K oi ie 2c 2 a 2K 2c ake 2 oc 2c ag a a 2 ie a 2 oi a oi a 2 2 oo ok Ok i Oo 2c 2 ok 2 2 OK 2K 2 2k 2K ok ok 2K 





Figure 2-9 Plot variable information as viewed by participant 

After viewing the graph, the participant, through use of a short menu screen, was 
given two options: 1) review the report and graph again; or 2) move to the next interval. 
The purpose here was to insure the participant had full access to the information to make 
decisions prior to moving to the next interval. 

The graph is displayed for the participant following this screen. The graph 1s 
depicted with the Y-axis displaying the numeric variable levels as shown in the report, and 
the X-axis depicting time in forty day intervals that appear incrementally following each 
successive interval. Numeric upper limits were carefully tested to insure plot information 


could be calculated given unusual staff level input. 


G. THE DOCUMENTATION 


Creating the written documentation for this experiment was an important part in 
ensuring the experiment'’s success. In order to eliminate any external bias in the 
experiment, it was imperative that the computer interface be maintained exactly the same 
for all groups. This resulted in the documentation being the only means for conveying the 

unique delay information to the participant. With this in mind, two primary areas were 
addressed. 

The first area provided clear and extremely detailed procedures for the participant 
to follow in setting up and conducting the experiment. These procedures fell into three 
categories: |) how to insert the disk and boot the experiment up; 2) how to initiate the 
TRIAL (TEST) run, this area also described in detail what each sequential screen was 
asking and/or displaying, and how to input the proper response or decision for that 
screen; and 3) howto run the actual experiment itself, this area included a description of 
indicators that would be encountered when the simulation was nearing completion. A 
copy of this documentation is contained in appendix D. 

The second area concerning the documentation was the most critical in that this 
was where the delays were described to the participants. Though the purpose of the 
experiment, as far as the participant was concerned, was to complete the project on time 
and on budget, the actual experiment itself rested solely on the way they handled the 


information about the delays described within their documentation. Copies of the project 


specific sets are contained in appendices E through H. Figure 2-10 shows a 


documentation excerpt. 


SOME IMPORTANT THINGS TO CONSIDER IN MAKING YOUR ESTIMATES: 
Your primary task is to update the project's staffing level. Every 
two-month(40 working days) reporting period, you will have the option to 
adjust the Project's staff level. You may find however, that the actual staff 
level in the status report is somewhat different from the staff level you 
chose. This will be due to things you cannot totally control such as delays in 
hiring. 

Because all personnel in the organization are already assigned to other 
projects, any staff additions you request will be hired from the outside. As a 
result, there will be a delay in hiring new staff and in assimilating them into 
your project. 


- The hiring delay will be 3 months (1.e., 60 working-days) on average. 


- The assimilation delay for a newly hired employee is typically 4 months 
(1.e., 80 working-days). This is the time it typically takes to train a new 
employee in the mechanics of the project and bring him/her up to speed. 
Because the organization does not have a formal training program, the 
training 1s done on the job by having one of the experienced staff members 
spend 25% of his/her time "hand-holding" the new employee. During this 4 
month training period, a new employee 1s typically only half as productive as 
an experienced employee. 





Figure 2-10 Excerpt from ProjyectA documentation concerning delays. 


This documentation was provided to ensure that the participants were completely 
aware of these delay periods. Care was taken to write the documentation in such a way 
as to focus their attention towards this information, and was captioned as being 
information important to the experiment. 

Other related documentation contained information needed by the participant to 
be totally aware of their responsibilities and to ensure the knowledge each participant had 
prior to the simulation was equal concerning their respective groups. Figure 2-11 shows 


this documentation. 


PROJECT 


The project that you will manage happens to have been a real project conducted in a real 
organization. The particular organization 1s on the leading edge in software engineering 


technology. For the project, you will be given a project profile containing the following 
initial information: 


Estimated Project Size (in Number of Tasks*) 
Estimated Project Cost (in Number of Person Days) 
Estimated Duration (in Number of Work Days) 
Size of the Initial Core Team (in People**) 


* A task is a software module that is approximately 50 lines of code in size. 
** The Core Team is the group of software professionals that developed the project's 


requirements’ specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 
YOUR TASK 


Your objective in setting the staffing level should be to finish on schedule 
while avoiding a cost overrun. Specifically you should: 


a) complete the project on schedule. 
b) at the lowest possible cost. 


Note: Finishing ahead of schedule will not gain you anything. In fact, it may hurt you. 
since finishing ahead of schedule will probably mean hiring more staff than needed. 
thus incurring a higher cost than required. 





Figure 2-11 Excerpt form ProjectA showing delay information 


Though the data was captured to .OUT files, the designer thought it necessary to 
maintain a Decision Record Sheet to manually record the staffing decisions the 
participants made during the simulation. This allowed for backup of this critical data as 


well as certification of the data should the need arise. This record sheet is provided in 


appendix K. 


D. TRIAL EXPERIMENT 


Once the gaming interface and documentation was complete, a trial experiment 


was conducted to provide feedback on any problems that may be encountered by the 


participants. Two students were chosen to participate in the trial experiment based on 
their understanding of personal computers and their abilities to properly critique this type 
of interface. The objective of the trial run was to allow observation of the participants 
interaction with the simulation environment and the documentation. Based on the 
students participation in this trial run, they were also chosen as lab assistants for the actual 
experiment. This was advantageous in that they would have prior insight into the 
simulation environment and would be able to provide useful guidance in the absence of the 


designer. The specific concerns the designer was attempting to examine were: 


- Are the participants comfortable with the gaming environment? 
- Are the instructions clear? 


- What type of questions do the lab assistants and the designer need to 
prepare to answer for the participants? 


- How long does the experiment take on average? 


Following are the majority of observations made during the experiment trial run: 


Both participants started the boot procedure without reading the start up 
documentation. Since the actual experiment will be conducted in a lab where machines 
boot up to a initial network screen, participants will have to be briefed to follow 
instructions explicitly as they may enter the network inadvertently. The two participants 
were briefed to read the instructions carefully. 


It was noted that when viewing the plot following the first interval, with no change 
being made to the staffing level, the lines overlapped each other making it difficult to 
comprehend what the plot was showing. This was later remedied by briefing the 
participants that if they choose not to change the staff level the first time around, they will 
see flat overlapping lines depicting no change for the time period. 


One participant tried to bypass the plot and found he could not, he indicated that it 
was Irritating that he could not just review the report without the plot. 
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Both subjects spent an excessive amount of time on the TEST portion of the 
experiment. This posed a potential problem in that the participants may try to learn the 
system too deeply prior to going onto the experimental phase so as to maximize their 
grade. 

One participant asked if, when the given staff level 3.5, would entering 4.5 mean 
that he had added one person? The partial person criteria will have to be briefed to the 
actual participants to ensure they are aware of how the simulation model calculates the 
staff level. 

One participant noted that due to the excruciating slow speed of operating off of 
the disk rather than the hard drive, the participants are apt to begin to talk amongst 
themselves. 

The participants took different approaches to solving the staffing level. One 
calculated the level using the established staffing equations, the other operated on intuition 


alone. 


The participant operating intuitively finished after one hour seventeen minutes. 
At one hour forty five minutes, the remaining participant completed the project. 


E. FINAL PREPARATIONS 


Having completed the software development, the written documentation, and the 
incorporation of lessons learned from the trial experiment, the final preparations 
commenced. 

Individual folders were developed for each participant. The documentation was 
specifically titled according to the appropriate group (A-D) and placed in folders titled for 
that particular group. Group disks were made up and annotated with the group letter and 
taped into a protective cover inside the folder. Once a participant had been randomly 
assigned to each of the four groups, their individual names were then assigned to a 
particular folder and disk for control purposes. This random sample will be discussed in 


chapter IIJ. The experiment documentation provided each group was identical with the 
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exception of the specific group .BAT file was identified (i.e. ProjectA.BAT) for input at 
the prompt when initiating the actual experiment. These were then filed in their respective 
folders. Lastly, a TEST and ACTUAL experiment staff level record was placed in each 
folder along with a pencil. Participants were to arrive at the lab with nothing but a 
calculator. 

Two laboratories were identified for use. These labs were represented in a 
computer drawing with each computer assigned to a specific group so as to separate the 
participants within the same group by at least one seat. These identified computers were 
later assigned to specific participants who were positioned in such a way as to ensure that 
no two participants of the same group label were in eyesight of each others terminal 
screen. LAB reservations were made and signs posted to keep non-participants from 
entering the lab during the experiment. Lab assistant folders were created and provided 
to the lab assistants. These folders contained seating arrangements, extra disks and 
documentation, pencils, etc... Also specific instructions were provided as to what the 
attendants could and could not assist the participants with. In the later case they were 
directed to consult the designer before taking any action. This added additional control to 


the experiment environment. 
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Hl. CONDUCTING THE EXPERIMENT 
A. TASKS AND PROJECT CHARACTERISTICS 

After a thirty minute review session, several days to review and learn the report 
format, and having had prior experience with the game interface, experiment participants 
were now more comfortable with the upcoming experiment. To ensure maximum 
preparation was given, participants were briefed that the TEST simulation was scheduled 
to be conducted immediately preceding the actual experiment. 

The simulation was designed to allow the participants to manage the simulation 
independently. Each participant was tasked to review reports and plots, and then update 
the project's staffing level every two calendar month (40 working days) interval until 
project completion. The participants used the interface to input their staffing level 
decision into the model thus modifying the model report output. The participants were 
told that their overall course grade would be impacted by their project's results. A 
statistical comparison of the grades indicated no statistical significance in the means across 
eeemes (F = 1.12:df=3,P>0.351) 

B. ORGANIZING THE EXPERIMENT 

The experimental introduction consisted of a thirty minute classroom training 
session in which the documentation, seating arrangements, and experimental guidelines 
were discussed. This also provided an opportunity to settle any last minute questions that 
may have been generated. The size of the group required that two separate sessions, both 


requiring the use of two labs simultaneously, be provided. One lab assistant was assigned 
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to each of the two labs to provide the individual folders to the participant's and to 
provide general guidance to the participants during the experiment. Each participant was 
checked to ensure that their name was assigned to the folder and associated disk they 
received before starting the experiment. The lab assistants were instructed to ensure 
everyone started at the same time. As illustrated in appendix J, seating arrangements 
were predetermined. However, if machines were found to be inoperable, the lab assistants 
were to reassign participants ensuring that no two participants with the same group 
identifier were within screen view of each other. Lab assistants were briefed that no 
guidance on how to calculate the staffing levels or how to interpret the reports was 
allowed. Each lab assistant had back-up disks and documentation. The experiment was 
conducted in a single day. 

All lab machines were checked the day prior to the experiment. Lab reservations 
were confirmed and signs posted. A last minute briefing was provided to the lab assistants 
to ensure all matters were understood. The experiment designer monitored both labs, 
visiting each approximately every half hour. 

(ee THE EXPERIMENTAL SUBJECTS 

Participants in this experiment were gathered from two segments of a Software 
Engineering and Management course, IS4300, at the Naval Postgraduate School. 
Segment one consisted of 24 students, segment two had 27 students. In order to 
randomize the sample population and assign them to the four groups, the following 


matched sample procedure was used [Ref. 4]. 


yup 


An alphabetical list for each segment was used along with a standard table of 
random digits to perform a two-level randomization [Ref. 5]. Appendix I includes the 
sample population randomizing worksheet used for each segment. Column A is the 
alphabetical listing of the participants in each segment. Column B 1s a two digit random 
number, taken from the standard table of random numbers [Ref. 5], assigned to each 
participant. The row of digits chosen was done randomly for each segment. Once the 
number was assigned, column C was generated listing the participants in numerical 
sequence. Column D then assigned the participants a number from | to 4 in a stepped 
sequential fashion (i.e. 1234, 2341, 3412, etc...). The final group randomization was 
accomplished by assigning the group letters A-D to these numbers by randomly assigning 
a letter to each number | through 4. In Column E, these letters were then assigned to the 
participant whose number was correlated with it. 

Prior to conducting the experiment, all participants were checked on the list to 
ensure they had received the advanced training by matching their name to an attendance 
sheet taken the day of the training session. It was determined that two participants did not 
receive this training and they were removed from the experiment. These participants are 
highlighted on the list in appendix I. 

D. DEPENDENT MEASURES 

There are three dependent variables. Information contained in this section can be 

referenced against figure 2-1 in chapter II. The first of these is the project cost as 


identified by the "Total Person Days Expended to Date" line. It represents the cost of the 
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project, in Person Days, at the end of the current interval. Upon project completion, it 
represents total project cost. Project completion is normally indicated when the "% 
Development Reported Complete" is 100 percent. However, an 97 percent completion 
level, accompanied by a elapsed time interval that is not a 40 day multiple, also indicated 
completion. To ensure all participants completed the project, lab attendants verified that 
each participant getting a completion indictor completed one more interval with absolutely 
no changes made. They then compared the two intervals and if the exact same results 
were experienced the participant could log off. 

The second dependent variable measured was the project's completion time. This 
variable was reflected in the line "New Est of Project Duration (start-end)". This line 
reflects the estimated completion date at the end of each 40 day interval. The DYNAMO 
simulation determines this variable on the basis of the status of the project at a specific 
moment in time. It reflects the projected completion date as calculated by the current 
input. 

The third and final dependent variable was the actual staffing level input by the 
participants. Though this variable was captured to the INFO file, participants were 


requested to annotate written documentation sheets to provide a back up if necessary. 
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IV. EXPERIMENTAL RESULTS AND ANALYSIS 
A. MODEL OF ANALYSIS 
The raw data produced by this single project experiment was input to a file called 
INFO (figure 2-4) which contained, the final project cost, final completion time, 
chronological staffing decisions and other necessary information for each participant. Our 


analysis focused on three dependent variables: 


1) Participant performance concerning staffing decisions 


2) The absolute value of deviation by the participant from an established 
optimum 


3) The absolute value of the percentage deviation each subject incurred 
from the optimum 


Analysis of this data was nent using the Statistical Analysis System (SAS). 
Specifically, the General Linear Model (GLM) procedure was used for multivariate 
analyses due to the unequal populations within the project groups. Appendix L illustrates 
the SAS control file from the demographic analysis, and appendix M_ shows the SAS 
control file used for the GLM and Repeated Measures analysis. This last file calculated 
two new variables, Doptimal and Poptimal. Doptimal represents the absolute deviation of 
the input staff levels for each subject in each interval in comparison to the optimal project 
staff level for that interval. Poptimal depicts the percentage deviation from the optimal 
staff level solution for each subject per interval. The following equations illustrate how 


these two variables are calculated: 


DD 


DOPTIMAL, = Absolute value of (Subject Staffing Decision, - Optimal Staffing Decision,) 


POPTIMAL, = Absolute value of (Subject Staffing Decision, - Optimal Staffing Decision) 
Optimal Staffing Decision, 


t= time interval 


B. RESULTS 
l. Staffing Level Decisions 
For each of the four groups, the mean staffing level was determined and plotted 


against the project time periods. This is shown in figure 4-1. 


STAFFING LEVEL DECISIONS 





Figure 4-1 Staffing Level Decisions for each group 

A significant number of participants completed the project before the seventh 
period (Time=240). In order to minimize the problem of missing values, only the first six 
periods were evaluated. The figure illustrates that all four groups initially increased staff 


size responding to group specific information. 
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The assimilation and hiring group initially increased its staff size at the 40 day mark 
in response to the realization that the delays would have significant impact on the project. 
At day 120, the assimilation and hiring group reduced staff size, but then increased back to 
the previous level at day 160 and beyond. 

The assimilation-only group increased staff size at the 40 and 80 day points as they 
responded to the realization that assimilation delays would cause the project to fall behind 
schedule if not compensated for at the beginning of the project. As the project progressed 
and the staff became more fully assimilated, the participants began to stabilize the staff size 
trying to meet reported cost and schedule projections. Near the end of the projects 
lifecycle, they realized that these projections were not fully being met and hired more 
people. In accordance with ‘Brook's Law' [Ref. 1], this decreased the likelihood of a 
successful completion as adding people to a late project makes it later. 

The hiring-only group initially hired staff and then remained steady responding to 
the project requirements with slight deviations of the staff levels. This indicates that the 
participants felt they had overcome the hiring delays early on and could maintain current 
staff levels. However, near the end of the project, they began reducing staff to meet cost 
and completion schedules. 

The no-delay group responded in a similar fashion to the hiring-only group. They 
hired staff up front, and maintained a steady level reacting to the immediate affects their 


input had on the project reports. 


a 


In conjunction with figure 4-1, Table 4-1 illustrates the repeated measure analysis 
of the overall staffing level decisions. The Within Subjects results show a significant 
Period effect (P < 0.05), indicating that the individual participants made different 
decisions as time progressed. However, the interaction, or PROJECT*PERIOD effect 


Table 4-1 REPEATED MEASURE ANALYSIS OF STAFFING LEVEL DECISIONS 


Source of Degrees of Significance 
variation Freedom of F 


Between Subjects 
Project 
Subjects-within 
-Projects 


Within Subjects 
Period 0.561 5,43 0.0001 
Project* Period 0.724 Tosti 0.4755 





is not significant (P > 0.05), indicating that the pattern of the decisions made was similar 
over time across the four groups. There was no significant difference Between Subjects, 
that is, the overall decisions of the subjects were not significantly different across the four 
groups (P > 0.1). 

Ze Deviation of staff levels from optimum (DOPTIMAL) 

Figure 4-2 illustrates the mean deviation of input staff levels from the optimum for 
each of the four project groups. As shown in this figure, assimilation and hiring group's 
staff level decisions deviated significantly from the optimal at day 80 of the projects 
lifecycle and continued to deviate for the remainder of the project .This is due to the 


difficulty each participant encountered handling both the assimilation and hiring delays. 
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Figure 4-2 Deviation from eet staff levels for each project (Absolute Value) 

The assimilation-only group drastically deviated from the optimum at the 120 day mark. 
This drastic deviation was due to the participants inaccurate attempt to overcome the high 
assimilation delay inherent to their project. This group then abruptly shifted back towards 
the optimum at day 200. The hiring-only group differed from the assimilation and hiring 
group and the assimilation only group in that it followed the optimal path more closely. 
As depicted earlier in figure 4-1 analysis, this is due to the more accurate attempt to 
counter the extreme hiring delays encountered. The no-delay group with minimal delays 
remained fairly steady along the optimal path as well. This is due to the simulation output 


giving immediate results the participants allowing them to modify the staff level more 
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accurately. There was a tendency at the end of the project to hire additional people to 
meet schedule and cost projections. This is common to most development projects. Table 
4-2 shows the repeated measures analysis of the overall deviation of staffing levels from 


their optimum solutions. 


Table 4-2 SUMMARY OF OPTIMAL SOLUTION DEVIATIONS REPEATED 
MEASURE ANALYSIS 


Source of Degrees of Significance 
variation SS Freedom F of F 
Between Subjects 

Project O19296 3 303 0.0383 

Subjects-within 

-Cells 4738.63 47 


Within Subjects 
Period 0.80 5,43 2.08 0.0864 
Project *Period 0.784 LE, OZ O7522 


The Within Subjects results indicate no significant Period effect (P > 0.05), indicating that 
the individual subjects made similar decisions as time progressed. Furthermore, the 
interaction or PROJECT*PERIOD effect, is not significant (P > 0.05), indicating that 
the pattern of the decisions made was similar over time between the four groups. There 
was significance Between Subjects with overall decisions of the subjects being 
significantly different across the four groups (P < 0.05). 

3. Percentage deviation of staffing level from Optimal (POPTIMAL) 

Figure 4-3 illustrates the percentage deviation of staff levels from the optimal for 


each group. 
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PERCENTAGE DEVIATION 
(From Project Optimal Levels) 





Figure 4-3 Percentage deviations between optimal and actual staff levels 

This figure indicates that the Assimilation-only, Hiring-only, and No-delay groups varied 
similarly, percentage-wise, from the optimal solutions. All three deviated more in the 
beginning then subsided toward the optimal. Only the assimilation and hiring delay 
group, varied severely throughout the project. This is due to the dynamic requirements the 
participants had of keeping track of the delays and their impacts on the project. 
Participants in assimilation and hiring group had to battle significant delays displayed to 
them via the project reports and had great difficulty foreseeing the next intervals 


interaction. The participants were unable to correctly isolate the optimal solution for 
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their projects. This is due to the burden managers face when juggling unpredictable 
information. 

Supporting figure 4-3, Table 4-3 illustrates the repeated measures analysis for the 

overall percentage deviation from the established optimal decision. The Within Subjects 

results indicate a non-significant Period effect (P > 0.05), indicating that the individual 


subjects made similar decisions as time progressed. 


Table 4-3 REPEATED MEASURE ANALYSIS OF PERCENTAGE DEVIATION 
FROM OPTIMAL 


Source of Degrees of Significance 
variation SS Freedom F of F 


Between Subjects 


Project 7.02 3 8.87 0.0001 
|  Subjects-within 
-Cells 12.41 47 


Within Subjects 
Period 0.869 5,43 1.29 0.2856 
Project*Period 0.766 15,119 0.80 0.6721 


Furthermore, the interaction or PROJECT*PERIOD effect, is not significant (P 
> 0.05), indicating that the pattern of the decisions made was similar over time between 
the four groups. These results indicate that the overall percentage deviation concerning 
staffing decisions was not significant across time (P > 0.05). However, a high Between 
Subjects effect indicates that the overall decisions of the subjects were different across the 


four groups (P < 0.1). 
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V. CONCLUSIONS 


A. FINDINGS AND IMPLICATIONS 


The objective of this thesis was to conduct an experiment focused on gaining 
insight into the implications assimilation and hiring delays have on a single software 
project management environment. 

This information is critical in that the Department of Defense, as well as other 
Federal agencies, are fighting a continuous battle against project cost and schedule 
overruns and need to find ways to remedy the situation. Delays heavily impact staffing 
decisions throughout the project's life cycle and therefore require in-depth understanding. 
This thesis provides empirical findings regarding the project managers behavior when 
handling these delays. 

The experimental ais confirm that excessive delays seriously affect the way a 
manager thinks and reacts concerning staffing decisions. Managers faced with significant 
assimilation and hiring delays often failed to handle them properly thereby creating adverse 
affects to the project. The overall findings of this research indicate that managers make 
better staffing level decisions when handling single delays then managers dealing with 
projects incurring multiple delays with significant delay periods. 

B. FURTHER RESEARCH 
There are several areas that can be potentially researched using the SDM model. 


One area to be researched could be to see if a team of managers could better foresee and 
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handle these associated delays. This could be done by replicating part of this experiment 
using teams of decision makers to see if the data changes significantly. 

Another area to be researched could be determining what information needs to be 
provided to a manager, and at what time during the project life cycle, to enhance the 
managers performance in handling delays. 


Lastly, perhaps evaluate the effects of delays on an multi-project environment. 
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APPENDIX A: DYNEX PROGRAM FILE (PROJ?.DNX) 


if #tm<.1 then 
display clear 
2K KK OK 2K ok 2K 2k 2k 2 2K ok 2k 2k ok 2 2K ok 2k 2k 2K ok 2k 2k 2K ok ok ok ok OK OK OK Ok KOK ok Ok 


I!!! Important Points to Remember !!!! 
2K 2K 2 KK OK KO 2K ok 2k 2k ok ok ok eK ee KK ok OK OK OK OK OK KK OK OK KOK OK KK 


- You are not allowed to discuss this exercise with anyone 
Other than a lab attendant. Please refrain from discussing 

this with members tn the other class until they have completed 
tiie €Xercise. 


- The system will show you the size of the initial core team of 
software developers (the full time equivalent number). It will 
then ask you for your initial desired staffing level. Next it 

will run through the first simulation time period and show you 
the current reported statistics. Make your change to the 
desired full time equivalent staffing level on the documentation 
sheet provided after reviewing the report. There is no need to 
turn in the documentation sheet after each interval. 


A LAB ATTENDANT MUST VERIFY YOUR FINAL RESULTS! 


- GOOD LUCK! Press <ENTER> to continue. 
dendq 
choice | 
cend 1/] 
display clear 
THE INITIAL CORE TEAM OF SOFTWARE 
DEVELOPERS HAS BEEN SET AT: 


3.5. Full time equivalent Personnel 


1) Press <ENTER> to keep that same 3.5 full time equivalent staff. 
OR 
2) Enter your initial desired staffing level and press <ENTER>. 


[Remember, you are working in full time equivalent personnel. ] 


The current staffing level = 
dendq 
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dq WFS1=0.5< 
display clear 


a eg er ZR cae 


'! IMPORTANT !! 


Make sure that you have written your staffing 
level decision down on the documentation sheet 
before continuing with the simulation. 


Press <ENTER> to keep the displayed number 
OR 


| 
| 
| 
| 
| 
| 
| 
This is your final opportunity to check and | 
| 
| 
| 
| 
Change the staffing level and then press <ENTER>. | 

| 

| 


| 
| 
| 
| 
| 
| 
| 
| 
| change the staffing level for this time period. 
| 
| 
| 
| 
| 
| 
| 


OOO GG I I a a a ak ak ak a ak ak 


Your subsystem selected staffing level = 
dendq 
qn isl Uso. 


else 


choice | 
cend 1/] 
display clear 


2 kk 2 2k 2K KK ok 2 kK KK 2 2K ok ok 2c kK ok 2 2k Ko 2K oo 2K 2K oo 2K 2K oo 2K 2K OK 2 2 KK OK KK ok ok OK OK 2K KK 


* MAKE YOUR CHANGE TO THE DESIRED STAFFING LEVEL * 


3K 3K 2K 2K 2k ok 2K KK 2K 2K Ko 2K 2K ok ok 2 2K 2 2K Ko 2K 2K oko 2K Ko 2K 2K 2 oe 2 2K kK 2K 2K KK OK ok KOK ok OK OK 


a) Press <ENTER> to keep the displayed staffing level. 
OR 
b) Enter the new desired staffing level and press <ENTER>. 


[Remember you are working in full time equivalent personnel] 


Your last desired staffing level was = 
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dendq 
gag WES 1=0.5< 
display clear 


tg EE EE EE ERE EAE EERE REE 


'! IMPORTANT !! 


| 
| 
Make sure that you have written your staffing | 
level decision down on the documentation sheet | 
before continuing with the simulation. | 


| 
| 
| 
| 
| 
| | 
| | 
| This is your final opportunity to check and | 
| change the staffing level for this time period. | 
| | 
| | 
| | 
| 
| 
| 
| 


Press <ENTER> to keep the displayed number 
OR 
Change the staffing level and then press <ENTER>. | 


Cac a gE ee 


Your subsystem selected staffing level = 
dendq 
aq WFS1=0.5< 


end 
display clear 


2K 2K 2K 2 2K 2k 2K 2K 2 ok 2K i 2 i 2 ake 2 ae 2k ake ok ake ok ae ok kc 2k Kg akc ake oie ake ake ake 2k akc ake 2K ak kc 2k oi 2k ake akc ke 26 2K afc akc 2 ok ae ok ok 2K 2k 2K 2k ok ok ok ok ok 2k 


+ * 
Press <ENTER> to run another interval and see the updated output. , 
x *K 


EE 2k 2k ok kK ok ok ok ok oi ok oC ao ok oo ok ok 


dendq 
choice | 
display clear 


3g 


te eee SSeS eS SEES SEES SS SES SSS SSS SSS SSS SSS SSS SSS SSS SSS SSS SS SSeS SS SS Ss 


* > 
* There will be a long pause as the system calculates your input! " 
* oK 


ROR ROO OR IIR II I IO KR kk 2K 2K ak ak 2K 2k 25 2 2 ak 2K 2k 2k ok: ak 2k ok 2k ak: ak ake kak 


dendq 

report 

time=maxtime, 

Format="5<,38<,53<",PICTURE="Z,ZZ9V" 

"CURRENT INTERVAL STATISTICS:","Elapsed Time =",tm:; 
Format="5<" 

"INTITIAL ESTIMATES: (These will not change throughout the project)"; 
FORMAT="8<,52<,66<" PICTURE="ZZZ,ZZZV" 

"Project Size", IPRJSZ,"Tasks"; 

FORMAT="8<,52<,66<" PICTURE="ZZZ,ZZZV" 

"Project Cost", TOTMDO,"Person-Days"; 
FORMAT="8<,52<,66<", PICTURE="ZZZ,ZZZV" 

"Project Duration", TDEV,"Days";: 
Format="5<,52<,66<",PICTURE="ZZ,ZZZ9V" 

"REPORTED STATISTICS at Time = = = = = =>" tm,"Days"; 
FORMAT="8<,52<,66<" PICTURE="ZZ,ZZZ9V" 

"Updated Estimate of Total Project Size",PJBSZ,"Tasks": 
FORMAT="8<,52<,66<",PICTURE="ZZ,ZZZ9V" 

"% Development Reported Complete", PDVRC,"Percent”; 
FORMAT="8<,52<,66<", PICTURE="ZZ,ZZZ9V" 

"Total Person Days Expended to-date", CUMMD,"Person Days"; 
FORMAT="8<,52<,66<" PPICTURE="ZZ,ZZZ9V" 

"New Est of Project Duration (start-end)",SCHCDT,"Days"; 
FORMAT="8<,52<,66<",PICTURE="ZZ,ZZZ9V" 

"Time Remaining" ,timerm," Days"; 

FORMAT="8<,52<,66<", PICTURE="ZZ,ZZZ9V.99" 

"Current Staff Size", FTEQWF,"People"; 
FORMAT="8<,52<,66<" ,PICTURE="ZZ,ZZZ9V" 

"Percent of Workforce that is Experienced" FRWFEX*100,"Percent”;, 
FORMAT="5<" 

"PRESS <ENTER> TO VIEW THE GRAPHICALLY DISPLAYED VARIABLES";, 
cend 1!/] 

spec md_length=#length+40 
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APPENDIX B: BATCH CONTROL FILE (PROJECT?.BAT) 


echo off 

CIES 

init 1 

GRAPHICS 

bat /N /p /s 

smlt PROJA -go = -prs = -ls -ns -plm 6 -bw 

rep PROJA INTRVAL -outf INTRVAL.OUT -t -bw >NUL 
rep PROJA INTRVAL -outf INTRVL.OUT -bw >NUL 

rep PROJA -t -bw >NUL 

timestmp 


-top dynex PROJA -in PROJA.STT -sc -ls -plm 6 -bw 
smlt PROJA -gm = -ns -plm 6 -bw 
capture 
rep PROJA INTRVAL -outf INTRVAL.OUT -t -bw >NUL 
rep PROJA INTRVAL -outf INTRVL.OUT -bw >NUL 
rep PROJA -bw >NUL 
call -top] 
Exit 
goto -top%A 


-top! timestmp 
MA = | 
ram 
cls 


-1~] **** VIEW PROJA STATUS REPORT ***### 8 #8 RRR RK KK 
rep PROJA PROJA -outf JUNK.OUT -t -sc -Is -plm 6 -bw 
INKEY %0 
bat /p /s 
cls 
color \lF 


-4~| **** VIEW GRAPHIC STAFFING PLOT **** 
BAT CLS 
BAT COLOR \IF 
BAT BEGTYPE 
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2K KK 2K 2 KK KK KK 2K KK KK KK KK KOK KK KK KKK 2 KK KK KK KK KKK KK KK KK 2K KK KK KK OK OK ok ok ok OK Ok OK 


\IA GRAPHICALLY DISPLAYED VARIABLES ls 


FORO ORO OOK KO OK KK a 2k KKK kK ak ak ak ak ak ak ak kak ak ak ak ak ak ok 


THE FOLLOWING VARIABLES WILL BE PLOTTED: 


WES 3. ee STAFF LEVEL YOU REQUESTED 

ETEOWE Wy CURRENT STAFF LEVEL 

BROW EN cee PERCENT OF STAFF THAT IS EXPERIENCED 
CMTRMD ..... CUMULATIVE PERSON-DAYS SPENT ON 


TRAINING NEW STAFF 


\IA AFTER VIEWING PLOT PRESS <ESC> TO CONTINUE \I1F 


\IA PRESS <ENTER> TO VIEW PLOT \IF 


END 


BAT INKEY %0 

BAT CLS 

REP PROJA PROFXPLA 
BAT /p /s 

color \lF 

ram 

cls 


\lF THIS MENU ALLOWS YOU TO REVIEW THE 
STATUS REPORT AND STAFFING PLOT AGAIN 
ue 


\ID 1 \IF VIEW YOUR SUBSYSTEM STATUS REPORT AND 
PLOT AGAIN 


\ID 2 \IF PROCEED TO SIMULATE NEXT TIME PERIOD 


Choose an option: (DO NOT HIT <ENTER> AFTER SELECTION!!!!) ; 
end 
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a oo 


Nes a ee LL 


-Istkey] inkey %0 | if %0 # = 1 type %0; 
if %0 = key01b return 
goto -%00~1 


-2ndkey! inkey %l | if %1 #= 1 type “ol; 
if %1 = keyOlb return 
if %1 = key020 goto -$%0$1 
if %1 = key00d goto -$%0$1 
if %1 = key008 goto -top1 
if %1 = key14b goto -top! 
goto -%0%1 1 


eee PROCEED WITH NEXT SIMULATION *°?*** #8 84888 eee REN 


BAT CLS 
BAT COLOR \IF 
BAT BEGTYPE 


tee tee eet eee SSS SSS SSS SSS SSS SS SSS SSS SSS SETS SSE SSE SEE SS SS SS ES SE SS SS 


WRITE YOUR NEW DESIRED STAFFING LEVEL ON THE 
DOCUMENTATION SHEET PROVIDED. 


— ee He ee 


PRESS <ENTER> 


A 2K 2 2K 2k KK GK OK 2K OK OK 2g OK ok 2K ie OK 2 OK OK 2 2 OE go 2 Og OK ok OK Ok 2 OK OK 2 OK 2 OK 2k KOK 2K 2 KOK 2k ok Ok OK. 


END 
bat /p /s goto -top 


-%0~1 
-$%0$ | 
-“0%11 beep goto -top 


-on.error- 
if %R > 82 if %R < 90 type !! Floating Point Error !! |goto -Calc. 
Cls beep type Unexpected batch file error %R in line %L |exit 
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APPENDIX C: BATCH CONTROL FILE (TEST.BAT) 


echo off 

CIES 

init | 

GRAPHICS 

bat /N /p /s 

smlt TEST -go = -prs = -ls -ns -plm 6 -bw 

rep TEST INTRVAL -outf INTRVAL.OUT -t -bw >NUL 
rep TEST INTRVAL -outf INTRVL.OUT -bw >NUL 

rep TEST -t -bw >NUL 

timestmp 


-top dynex TEST -in TEST.STT -sc -ls -plm 6 -bw 
smlt TEST -gm = -ns -plm 6 -bw 
capture 
rep TEST INTRVAL -outf INTRVAL.OUT -t -bw >NUL 
rep TEST INTRVAL -outf INTRVL.OUT -bw >NUL 
rep TEST -bw >NUL 
call -top] 
Exit 
goto -top%A 


-topl timestmp 
MA = | 
ram 
cls 


-|~] 2K OK OK ok VIEW TEST STATUS REPORT 2K 2K 2 OK 2k OK ok ok ok ok 2K 2K OK OK ok ok OK ok OK ok 
rep TEST TEST -outf JUNK.OUT -t -sc -ls -plm 6 -bw 
INKEY %0 
bat /p /s 
cls 
color \lF 


-4~] **** VIEW GRAPHIC STAFFING PLOT **** 
BAT CLS 
BAT COLOR \IF 
BAT BEGTYPE 
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3k 2K 2K 2 2k 2K 2K OK 2K 2K KK 2K KK OK 2K 2K 2K 2K 2K 2K 2K > 2K 2K 2K 2k 0K 2k 2K 0k 2K 2K OK 2K 2K OK 2K OK OK 2K OK 2K OK 2k 2K 2K 2k 2K 2k 2K 2K 2K 2K 2K 2K 2K 2K 2K 2k 2K 2K 2K 2K ok 


\1A GRAPHICALLY DISPLAYED VARIABLES VIE 


2 KK 2K OK 2K 2 oi 2 2K 2 2K 2c oie ok 2c oi 2c 2K 2 2K 2K oc oi 2c oi 2K 2c 2c ok 2c 2 OK 2G 2 2c 2 2c 2 2c 2K ik ok 2 oc oc ok OK oie oi ko KOK ok ok ok ok Ok 


THE FOLLOWING VARIABLES WILL BE PLOTTED: 


1 STAFF LEVEL YOU REQUESTED 

Pew... CURRENT STAFF LEVEL 

PRWEFEX...... PERCENT OF STAFF THAT IS EXPERIENCED 

CMTRMD..... CUMULATIVE PERSON-DAYS SPENT ON TRAINING 
NEW STAFF 


\1A AFTER VIEWING PLOT PRESS <ESC> TO CONTINUE \IF 


\IA PRESS <ENTER> TO VIEW PLOT \1F 


END 


_ 


BAT INKEY %0 

BAT CLS 

REP TEST TESTFXPL 
BAT /p/s 

color \lF 

ram 

cls 


begtype 


\IF THIS MENU ALLOWS YOU TO REVIEW THE 
STATUS REPORT AND STAFFING PLOT AGAIN 
\IF 


\ID 1 \IF VIEW YOUR SUBSYSTEM STATUS REPORT AND 
PLOT AGAIN 


\ID2 \IF PROCEED TO SIMULATE NEXT TIME PERIOD 


Choose an option: (DO NOT HIT <ENTER> AFTER SELECTION!!!!) ; 
end 
-Istkey] inkey %0 | if %0 # = | type %0; 


if %0 = keyOlb return 


goto -%0~|] 


-2ndkey1 inkey %l | if %1 #= 1 type %l:; 
if %1 = keyOlb return 
if %1 = key020 goto -$%0$1 
if %1 = keyO00d goto -$%0$1 
if %1 = key008 goto -top1 
if %1 = key14b goto -top! 
goto -%0%1 | 


-2~] **** PROCEED WITH NEXT SIMULATION ***## ### #44 44 4 4 4 4% 
BAT CLS 
BAT COLOR \IF 
BAT BEGTYPE 


2K 2K 2k 2k 2K Kk 2 2k 2k OK 2 2k 2k 2k Ok 2k OK OK OK KK Ok KK OK OK OK KOK KOK OK OK KOK OK OK KK KOK OK KK KOK KK KOK KOK OK KK KK KK KK KK KK 


WRITE YOUR NEW DESIRED STAFFING LEVEL ON THE 
DOCUMENTATION SHEET PROVIDED. 


%* *+§ %%F K* * 
¥ %* * % 


PRESS <ENTER> 


AE OK 6 RK KK RK OK KK KK KK KKK KK KK OK KK KOK KOK KOK KOK KOK OK KK KK KKK. 
4 


END 
bat /p /s goto -top 


-%0~ 1] 
-$%0$ 1 
-%0%11 beep goto -top 


-On.error- 


if %R > 82 if %R < 90 type !! Floating Point Error !! |goto -Calc. 
Cls beep type Unexpected batch file error %R in line %L [exit 


ts 


APPENDIX D: EXPERIMENT PARTICIPATION GUIDELINES 


KAKKEEEKKOYHO NOT START THE NETWORK!!! *****#*** 


A. TRIAL RUN 


This TRIAL RUN portion (1 thru 15) of the instruction set will take you through both the 
initial set up and training portions of the experiment. Follow the instructions carefully. If 
any problems arise, immediately seek out the lab attendant. 


1). Insert the disk into the appropriate drive. 
2). From the c:\> prompt change to the appropriate drive (ex: b: press <ENTER>) 
3). Type TESTat the b:\> prompt to begin the trial run. (ex: TEST press <ENTER>) 


4) You are now looking at the PERSONAL IDENTIFICATION screen. Enter your Last 
name, press <ENTER>, then enter your SMC number, press <ENTER>. 


5). You are now looking at the INTRODUCTORY SCREEN. Please ensure you read it 
carefully and follow the rules completely!. Press <ENTER> 


6). You are now looking at the INITIAL STAFFING LEVEL screen. You can keep the 
number shown or change the number to any you desire. Press <ENTER> 


7). You are now looking at the ENSURE YOUR ANSWER screen. This screen prompts 
you to document your entry on the document sheet, and allows you to verify the answer 
you have entered OR change the answer if you like. Press <ENTER> 


8). This next screen tells you that you are about to run the interval with the staffing level 
you have chosen. There is a moderate pause. Press <ENTER> 


9). The system will now generate the project report for a period of forty days.. Review 
this report to become acquainted with the displayed information. Press <ENTER> 


10). You are now looking at the GRAPHICALLY DISPLAYED VARIABLES screen. 
This screen shows you the variables that are going to show up on the plot. It is important 
that you know these variables and how they relate to each other. These acronyms , their 


meanings and their scale follow. Press <ENTER> 
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WES... STAFF LEVEL YOU REQUESTED (0 to24) 


FTEQWE o.0cccccccecccsens CURRENT STAFF LEVEL (0 to 24) 

FRWEEX oococccccccceeeese: PERCENT OF STAFF THAT IS 
EXPERIENCED (0 to 100) 

CMTRMD..........0.... CUMULATIVE PERSON-DAYS SPENT ON 


TRAINING NEW STAFF (0 to 150) 


11). You are now looking at the VARIABLES PLOT. Take a moment to review the 
scale of each variable (labeled at top of screen) and how the colored lines vary over time. 
- Press <ESC> (pressing anything other than ESC will regenerate the plot) 


12). You are now looking at the REVIEW MENU. This menu allows you to press (1) to 
return to the status report and plot perhaps for another look OR to press (2) to proceed to 
the next interval (DO NOT PRESS ENTER AFTER HITTING THE DESIRED 
NUMBER). Press (2) 


13). You are now looking at the PROCEED THROUGH NEXT INTERVAL SCREEN 
with a prompt for you to document your staffing level. Press <ENTER>. 


14). You are now at the CHANGE STAFFING LEVEL screen. Continue through at least 
two more intervals to become comfortable with the experiment. 


15). After you are familiar with the system, proceed until you are looking at the REVIEW 
MENU. PRESS <ESC>. You will see the Drive Prompt appear. 


16) Proceed to section 2. 
2. TO RUN THE EXPERIMENT: 


1). Follow instructions on the screens as illustrated above in the TRIAL RUN portion. 
Ensure that you enter your staff decisions on the attached documentation sheet when 
prompted. 


2). The experiment is complete when the (% Development Reported Complete" and % 
Test Reported Complete" both = 100 OR the generated reports cease to increment to 


another 40 day interval. (IN EITHER CASE, CHECK WITH THE LAB 
ASSISTANT BEFORE STOPPING). 


3) Upon clearance from the lab attendant, exit the system by continuing to the review 
menu and pressing <ESC>. Take the disk from the machine and place it and all 
documentation, including your scratch paper, in the folder provided. 


4). Type: PROJECTA _ to begin the experiment. GOOD LUCK!!! 
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APPENDIX E: EXPERIMENT DOCUMENTATION AND 
INSTRUCTION SET 
(SET A) 


YOUR NAME: 
SMC NO: 


INTRODUCTION 


The exercise you are about to undertake is similar in many ways to the flight 
simulators that pilots use to mimic flying an aircraft from takeoff at point A to landing at 
point B. Instead of flying an aircraft, though, this simulator mimics the life of a real 
software project from the start of the design phase until the end of testing. In this 
simulation, you will be more than an observer. In fact, you will play an important role on 
the project: that of the project manager. 

Specifically, your role will be to track the project's progress by reviewing status 
reports that will be produced for you at two-month intervals (40 working days) during the 
project. As the project manager, you must then update the project's staffing level based on 
the knowledge you gain from these reports. You can hire additional staff or decrease the 
staffing level as you deem necessary to complete the project. 


PROJECT 


The project that you will manage happens to have been a real project conducted in 
a real organization. The particular organization is on the leading edge in software 
engineering technology. For the project, you will be given a project profile containing the 
following initial information: 


Estimated Project Size (in Number of Tasks*) 
Estimated Project Cost (in Number of Person Days) 
Estimated Duration (in Number of Work Days) 
Size of the Initial Core Team (in People**) 
* A task is a software module that is approximately 50 lines of code in size. 
** The Core Team 1s the group of software professionals that developed the project's 
requirements’ specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 
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YOUR TASK 


Your objective in setting the staffing level should be to finish on schedule while 
avoiding a cost overrun. Specifically, you should try to : 


a) complete the project on schedule. 
b) at the lowest possible cost. 


Note: Finishing ahead of schedule will not gain you anything. In fact, it may hurt 
you, since finishing ahead of schedule will probably mean hiring more staff than needed, 
thus incurring a higher cost than required. 


SOME IMPORTANT THINGS TO CONSIDER IN MAKING YOUR 
ESTIMATES: 


Your primary task is to update the project's staffing level. Every two-month (40 working 
days) reporting period, you will have the option to adjust the project's staff level. You 
may find however, that the actual staff level in the status report is somewhat different from 
the staff level you chose. This will be due to things you cannot totally control such as 
delays in hiring. 


Because all personnel in the organization are already assigned to other projects, any staff 
additions you request will be hired from the outside. As a result, there will be a delay in 
hiring new staff and in assimilating them into your project. 


- The hiring delay will be 3 months (1.e., 60 working-days) on average. 
- The assimilation delay for a newly hired employee is typically 4 months 


(1.e., 80 working-days). This is the time it typically takes to train a new employee 
in the mechanics of the project and bring him/her up to speed. Because the organization 
doesnot have a formal training program, the training 1s done on the job by having one 
of the experienced staff members spend 25% of his/her time “hand-holding" the new 
employee. During this 4 month training period, a new employee ts typically only half as 
productive as an experienced employee. 
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APPENDIX F: EXPERIMENT DOCUMENTATION AND 
INSTRUCTION SET 
(SET B) 


YOUR NAME: 
SMC NO: 


INTRODUCTION 


The exercise you are about to undertake is similar in many ways to the flight 
simulators that pilots use to mimic flying an aircraft from takeoff at point A to landing at 
point B. Instead of flying an aircraft, though, this simulator mimics the life of a real 
software project from the start of the design phase until the end of testing. In this 
simulation, you will be more than an observer. In fact, you will play an important role on 
the project: that of the project manager. 

Specifically, your role will be to track the project's progress by reviewing status 
reports that will be produced for you at two-month intervals (40 working days) during the 
project. As the project manager, you must then update the project's staffing level based on 
the knowledge you gain from these reports. You can hire additional staff or decrease the 
staffing level as you deem necessary to complete the project. 


PROJECT 


The project that you will manage happens to have been a real project conducted in 
a real organization. The particular organization is on the leading edge in software 
engineering technology. For the project, you will be given a project profile containing the 
following initial information: 


Estimated Project Size (in Number of Tasks*) 
Estimated Project Cost (in Number of Person Days) 
Estimated Duration (in Number of Work Days) 
Size of the Initial Core Team (in People**) 


* A task is a software module that is approximately 50 lines of code in size. 

** The Core Team is the group of software professionals that developed the project's 
requirements’ specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 
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YOUR TASK 


Your objective in setting the staffing level should be to finish on schedule while 
avoiding a cost overrun. Specifically, you should try to - 


a) complete the project on schedule. 
b) at the lowest possible cost. 


Note: Finishing ahead of schedule will not gain you anything. In fact, it may hurt 
you, since finishing ahead of schedule will probably mean hiring more staff than needed, 
thus incurring a higher cost than required. 





SOME IMPORTANT THINGS TO CONSIDER IN MAKING YOUR 
ESTIMATES: 


Your primary task is to update the project's staffing level. Every two-month (40 working 
days) reporting period, you will have the option to adjust the project's staff level. You 
may find however, that the actual staff level in the status report is somewhat different from 
the staff level you chose. This will be due to things you cannot totally control such as 
delays in hiring. 





Because all personnel in the organization are already assigned to other projects, any staff 
additions you request will be hired from the outside. As a result, there will be a delay in 
hiring new staff into your project. 


- The hiring delay will be 3 months (1.e., 60 working-days) on average. 


- The new staff are hired from a specific contractor with whom the organization 
has had a long-term relationship. Because the contractor's personnel are very familiar with 
your organization's projects and development environment, they can be assimilated and 
brought up to speed very quickly. The assimilation delay for a newly hired employee is 
typically 12 days. This is the time it typically takes to train the employee in the mechanics 
of the project and bring him/her up to speed. During this 12 day training period, the 
employee is typically less productive than an employee already on the project. Because we 
do not have a formal training program, the training is done on the job by having one of the 
experienced staff members spend 25% of his/her time "hand-holding” the new employee. 
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APPENDIX G: EXPERIMENT DOCUMENTATION AND 
INSTRUCTION SET 
(SET C) 


YOUR NAME: 
SMC NO: 


INTRODUCTION 


The exercise you are about to undertake is similar in many ways to the flight 
simulators that pilots use to mimic flying an aircraft from takeoff at point A to landing at 
point B. Instead of flying an aircraft, though, this simulator mimics the life of a real 
software project from the start of the design phase until the end of testing. In this 
simulation, you will be more than an observer. In fact, you will play an important role on 
the project: that of the project manager. 

Specifically, your role will be to track the project's progress by reviewing status 
reports that will be produced for you at two-month intervals (40 working days) during the 
project. As the project manager, you must then update the project's staffing level based on 
the knowledge you gain from these reports. You can hire additional staff or decrease the 
staffing level as you deem necessary to complete the project. 


PROJECT 


The project that you will manage happens to have been a real project conducted in 
a real organization. The particular organization is on the leading edge in software 
engineering technology. For the project, you will be given a project profile containing the 
following initial information: 


Estimated Project Size (in Number of Tasks*) 
Estimated Project Cost (in Number of Person Days) 
Estimated Duration (in Number of Work Days) 
Size of the Initial Core Team (in People**) 


* A task is a software module that is approximately 50 lines of code in size. 

** The Core Team is the group of software professionals that developed the project's 
requirements’ specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 
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YOUR TASK 


Your objective in setting the staffing level should be to finish on schedule while 
avoiding a cost overrun. Specifically, you should try to : 


a) complete the project on schedule. 
b) at the lowest possible cost. 


Note: Finishing ahead of schedule will not gain you anything. In fact, it may hurt 
you, since finishing ahead of schedule will probably mean hiring more staff than needed, 
thus incurring a higher cost than required. 





SOME _IMPORTANT __THINGS TO CONSIDER IN MAKING YOUR 
ESTIMATES: 


Your primary task is to update the project's staffing level. Every two-month (40 working 
days) reporting period, you will have the option to adjust the project's staff level. You 
may find however, that the actual staff level in the status report is somewhat different from 
the staff level you chose. This will be due to things you cannot totally control such as 
delays in hiring. 


Because your project is a high priority project, any staff additions you request will be 
transferred to you from other ongoing projects within the organization rather than hiring 
people from the outside. This will minimize the delays in transferring new people to the 
project. 


- The transfer delay will be 9 days on average. 


- The assimilation delay for a newly transferred employee is typically 80 days. 
This is the time it typically takes to train the transferee in the mechanics of the project and 
bring him/her up to speed. Because we do not have a formal training program, the 
training is done on the job by having one of the experienced staff members spend 25% of 
his/her time hand-holding" the transferee. During this 80 day training period, the transferee 
1s typically less productive than an employee already on the project. 
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APPENDIX H: EXPERIMENT DOCUMENTATION AND 


INSTRUCTION SET 
(SET D) 
YOUR NAME: 
SMC NO: 
INTRODUCTION 


The exercise you are about to undertake is similar in many ways to the flight 
simulators that pilots use to mimic flying an aircraft from takeoff at point A to landing at 
point B. Instead of flying an aircraft, though, this simulator mimics the life of a real 
software project from the start of the design phase until the end of testing. In this 
simulation, you will be more than an observer. In fact, you will play an important role on 
the project: that of the project manager. 

Specifically, your role will be to track the project's progress by reviewing status 
reports that will be produced for you at two-month intervals (40 working days) during the 
project. As the project manager, you must then update the project's staffing level based on 
the knowledge you gain from these reports. You can hire additional staff or decrease the 
staffing level as you deem necessary to complete the project. 


PROJECT 


The project that you will manage happens to have been a real project conducted in 
a real organization. The particular organization is on the leading edge in software 
engineering technology. For the project, you will be given a project profile containing the 
following initial information: 


Estimated Project Size (in Number of Tasks*) 
Estimated Project Cost (in Number of Person Days) 
Estimated Duration (in Number of Work Days) 
Size of the Initial Core Team (in People**) 


* A task is a software module that is approximately 50 lines of code in size. 

** The Core Team is the group of software professionals that developed the project's 
requirements’ specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 
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YOUR TASK 


Your objective in setting the staffing level should be to finish on schedule while 
avoiding a cost overrun. Specifically, you should try to : 


a) complete the project on schedule. 
b) at the lowest possible cost. 


Note: Finishing ahead of schedule will not gain you anything. In fact, it may hurt 
you, since finishing ahead of schedule will probably mean hiring more staff than needed, 
thus incurring a higher cost than required. 





SOME _IMPORTANT _THINGS TO CONSIDER IN MAKING YOUR 
ESTIMATES: 


Your primary task is to update the project's staffing level. Every two-month (40 working 
days) reporting period, you will have the option to adjust the project's staff level. You 
may find however, that the actual staff level in the status report is somewhat different from 
the staff level you chose. This will be due to things you cannot totally control such as 
delays in hiring. 





Because the project is a high priority project, any staff additions you request will be 
transferred to you from other ongoing projects within the organization rather than hiring 
people from outside. This will minimize the delays in transferring and assimilating new 
people to the project. 


- The transfer delay will be 9 days on average. 


- The assimilation delay for a newly transferred employee is typically 12 days. 
This is the time it typically takes to train the transferee in the mechanics of the project and 
bring him/her up to speed. During this 12 day training period, a transferee is typically less 
productive than an employee already on the project. Because we do not have a formal 
training program, the training is done on the job by having one of the experienced staff 
members spend 25% of his/her time "hand-holding" the transferee. 
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APPENDIX I: 


1S 4300 





A 
Bryant 
Logan 
Lovelace 
Loveless 
McDermitt 
McGaha 
Meisch 
Neilan 
Ott 
Quinn 
Russo 
Sandjojo 
Shadle 
Smith 
Stewart 
Suhadi 
Sweeney 
Therriault 
Tillery 
Tsongas 
Tutt 
VanNederveen 
Walsh 
Walters 
Weatherford 
Whitten 
Wiedenhoeft 


p IS 


© 


COCO BRB WN KY OWA 


SEGMENT ONE 


D 
Lovelace 
Meisch 
Whitten 
Wiedenhoeft 
Bryant 
Sweeney 
Tutt 
Walters 
Sandjojo 
Shadle 
Smith 
Tillery 
Ott 
Walsh 
Suhadi 
Neilan 
Tsongas 
Russo 
Stewart 
Logan 
Weatherford 
Quinn 
Loveless 
VanNederveen 
McDermitt 
Thernault 
McGaha 
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SAMPLE RANDOMIZED POPULATION WORKSHEET 


Or OOP UDA PBA rPBUF AMF TAP TVA PVA PUTO 


SAMPLE RANDOMIZED POPULATION WORKSHEET 


1$4300 
A 


Bennett 
Biggs 
Bower 
Bunn 
Buxton 
Carlson 
Celia 
Cheatum 
Clancy 
Crawford 
Day 
Devries 
Dills 
Dwiggins 
Freeman 
Fuller 
Gambrino 
Hollowell 
Johnson 
Landau 
IFEe 
Sufian 
Swanson 


Swett 


SEGMENT TWO 
D 
Devries 
Bunn 
Dwiggins 
Bower 
Crawford 


Dills 
Biggs 
Johnson 
Freeman 
Carlson 
Celia 
Clancy 
Fuller 
Ieee 

Day 
Swett 
Landau 
Gambrino 
Buxton 
Bennett 
Swanson 
Hollowell 
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APPENDIX J: SEATING CHARTS 
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APPENDIX K: EXPERIMENT DECISION RECORD SHEET 


Initial Project Estimates 


Estimated Project Size............... (397 Tasks*) 
Estimated Project Cost ............. (1,111 Person Days) 
Estimated Duration................... (320 Working Days) 


Size of the Initial Core Team....(3.5 Full Time Equivalent Personnel**) 


* A task is a software module that is approximately 50 lines of code in size. 

** The Core Team is the group of software professionals that developed the project's 
requirements specifications. (Remember, you are taking over at the beginning of the 
Design Phase). 


Please enter your project staffing decisions below: Your initial decision is the initial staff 
level provided by the system or the change you make to that level. 


STAFFING (FULL TIME EQUIVALENT PERSONNEL) 

Initial Decision : 

Time Elapsed - 40 days: 
Time Elapsed - 80 days: 
Time Elapsed - 120 days: 
Time Elapsed - 160 days: 
Time Elapsed - 200 days: 
Time Elapsed - 240 days: 
Time Elapsed - 280 days: 
Time Elapsed - 320 days: 
Time Elapsed - 360 days: 
Time Elapsed - 400 days: 
Time Elapsed - 440 days: 
Time Elapsed - 480 days: 
Time Elapsed - 520 days: 


**** WHEN YOU ARE DONE, CALL FOR A LAB ATTENDANT **** 


so 


APPENDIX L: DEMOGRAPHIC SAS CONTROL FILE 


libname datename "c:\sas\saswork\": 
data demograp.dat; 

infile '"c:\sas\saswork\demofile.txt"; 
input NUMBER 1-7 NAME §$ 19-12 SMC 16-19 PROJ $ 24-27 CURRIC $ 40-42 SEX $ 
48-50 AGE $ 55-58 WORK $ 62-66 YEARS $ 70-74 COMP $ 79-83 HOURS $ 87-93 
GRADE: 
list; 
proc print; 

title 'Demographic profiles’ 
proc means; 

var GRADE: 

by proj; 

title ‘Statistics for individual project groups’; 

proc anova; 

classes proj; 

model GRADE=PROJ: 

title 'Grades ANOVA for different teams' 
run; 
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APPENDIX M: SAS GLM AND REPEATED MEASURES CONTOL FILE 


DATA REPEATED (KEEP = LNAME PROJECT PERIOD STAFF); 
INFILE "PROC! DAT"; 
input Iname $ project $ period $ naive opthd optad optha wfneed cummd 
pdvrc ptktst pjbsz cmtkdv cummd schcdt timerm fteqwf frwfex 
time staff: 
if(Iname="WEATHERF') then delete; 


/* Description of data fields 
opthd: Optimal hiring delay. 
optad: optimal assimilation delay. 
optha: optimal hiring and assimilation delay. 
wineed: NASA's decision. 
cummd: mandays expended to date. 
pdvrc: percentage development complete. 
pktst: percentage testing complete. 
pjbsz: perceived job size. 
cmtkdev: cumulative tasks developed. 
schcdt: scheduled completion date. 
timerm: time remaining. 
fteqwf: current workforce size. 
frwfex: percentage workforce size. 
Project: A - Hiring+Assimilation delay. 

B - Hiring delay. 

C - Assimilation delay. 

D - No delay. 
= / 


if ((period NE '0.00') 
and (period NE '40.00") 
and (period NE '80.00') 
and (period NE '120.00") 
AND (PERIOD NE '160.00') 
AND (PERIOD NE '200.00')) 
/* AND (PERIOD NE '240.00'))*/ 
then delete: 


6] 


/* THIS CODE WAS FOR INITIAL ANALYSIS PORTION*/ 


IF (PROJECT ='A') THEN OPTIMAL=OPTHA: 

ELSE IF (PROJECT = 'B') THEN OPTIMAL=OPTHD: 
ELSE IF (PROJECT = 'C') THEN OPTIMAL=OPTAD; 
ELSE IF (PROJECT = 'D') THEN OPTIMAL=NAIVE; 


IF (OPTIMAL < 0) THEN OPTIMAL = MIN (FTEQWF, NAIVE); 


DOPTIMAL = ABS(STAFF-OPTIMAL); 
POPTIMAL = ABS(STAFF-OPTIMAL)/OPTIMAL, 


DIFNAIVE = ABS(STAFF-NAIVE): 
PDFNAIVE = ABS(STAFF-NAIVE)/(NAIVE); 


PROC SORT; 
BY PROJECT PERIOD; 


PROC PRINT; TITLE ' MJB THESIS STATS ' 
VAR LNAME PROJECT PERIOD; 


PROC MEANS; BY PROJECT PERIOD; 
TITLE ' THESIS MEANS LISTING’; 
proc glm; 
CLASS PROJECT PERIOD; 
MODEL STAFF NAIVE OPTAD OPTHD OPTHA 
TIME = PROJECT PERIOD PROJECT*PERIOD; TITLE 'GLM STATS’; 
MODEL OPTIMAL DOPTIMAL POPTIMAL= PROJECT PERIOD 
PROJECT*PERIOD; 


/* THIS IS A SECOND PORTION OF CODE WORKING TOWARDS REPEATED 
MEASURES*/ 


PROC SORT DATA=REPEATED OUT=SORT; 
BY PROJECT LNAME PERIOD; 


PROC TRANSPOSE DATA=SORT OUT=TRANS: 


BY PROJECT LNAME:; 
ID PERIOD; 
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PROC PRINT DATA=TRANS: 
PROC GLM DATA=TRANS; 
CLASS PROJECT: 

MODEL 0D00_ 40D00 80D00_120D00 160D00 200D00=PROJECT/NOUNI: 


MEANS PROJECT/SCHEFFE; 
REPEATED PERIOD POLYNOMIAL/SHORT SUMMARY; 


PROC MEANS; 
VAR 0D00 40D00 80D00 _120D00_160D00_200D00; 
BY PROJECT: 


run; 
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APPENDIX N: SAS DEMOGRAPHIC FILE 


SMC 
NAME BOX 


BENNETT 1559 
BIGGS 140] 
BOWER 1810 
BRYANT 2798 
BUNN 2373 
BUXTON 2910 
CARLSON 2962 
CARVER 2306 
CELIA 1557 
CLANCY 2904 
CONROY 1286 
CRAWFOR 2089 
DAY 1337 
DEVRIES 1659 
DILLS 2893 
DWIGGIN 2434 
FREEMAN 1020 
FULLER 1259 
GAMBRIN 2189 
HOLLOWE 1191 
HUBBARD 1110 
JOHNSON 2986 
LANDAU 2271 
LEE 2847 
LOGAN 2432 
LOVELAC 1054 
LOVELES 2911 
MCDERMI 1313 
MCGAHA 1064 
MEISCH 1294 
NEILAN 2628 
OTT 2913 
QUINN 1937 
RUSSELL 2167 
RUSSO —_ 223 


SANDJOJ 211! 
SHADLE 2145 
SMITH 2356 


SFEGELE 2796 
STEWART 1409 
SUHADI 2087 
SWANSON I515 
SWEENEY 2905 
SWETT 1088 
THERRIA 1099 
TILLERY 1879 
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TUE 1443 
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WALSH 1377 
WALTERS 155] 
WEATHER 1553 
WHITTEN 2765 
WIEDEN 1623 


a2) 


ROJ 


G 


POWANAIANAS SFUSFTWOUQNWDOPFONPFOwOoOUFoUwnoFraAyrrYrrPFUNINTITINADWMWNONONS WOWPTWoYU 


24 2 eZee eee Ze ee eS ee ee, Zee, 2 ee, Gee 


CURRIC 


370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 
370 


SEX 


Secs "“s "ge "Sects e “2S 252550952525 52525 25 5 Shee 6 5 2 eee Solo — 8 eee 


AGE 


28 
39 
SZ 
28, 
42 
32 
32 
31 
Zi 


33 
30 
28 
33 
35 
37 
33 
35 
30 
oT 
a7, 
30 
42 
28 
a 
28 
30 
26 
30 
28 
29 
28 
28 
29 
a7 
4] 


oul 
29 
36 
43 
33 
51 
a2 
a2 
ae 
29 
2] 
28 
Sy 
ao 
37 
30 
34 


64 


WORK 
EXP 


7 
21 
10 
13 
19 
14 

14 

4 

5 
21 
14 

ti 

7 
1] 
16 
19 
16 
2 

7 
10 


YEARS 
SINCE 


a i ie 


— ~) 00 


AAAALUWAIAWO AAW F ~YN OO ~~) 


COMP 
FAMIL 


— MONO AIA AWA OTONAHA BANA ONOANAYAAWOW OUO HWA WO ADAM SOWA HAM CSO hYQNMOUNNMNAAA AWN AH 


HOURS 
USE 


NUMERIC 
GRADE 


33 
27 
37 
an 
a 
Say, 
30 
40 
40 
33 
37 
ay 
xT 
33 
40 
33 
2d 
33 
30 
ey) 
a5 
a 
30 
a3 
40 
40 
ay, 
37 
30 
30 
33 
40 
40 
a 
33 
oh 
40 
30 
40 
a7) 
33 
40 
40 
40 
a7 
40 
33 
30 
37 
30 
40 
33 
Sy) 
40 


BENNETT 


BENNETT 


BENNETT 


BENNETT 


BENNETT 


BENNETT 
BENNETT 
BENNETT 


BIGGS 
BIGGS 
BIGGS 
BIGGS 
B1GGS 
BIGGS 
BIGGS 
BIGGS 
BIGGS 
BIGGS 


BOWER 
BOWER. 
BOWER 
BOWER 
BOWER 
BOWER 
BOWER 
BOWER 
BOWER 
BOWER 


BRYANT 
BRYANT 
BRYANT 
BRYANT 
BRYANT 
BRYANT 
BRYANT 
BRYANT 
BRYANT 
BRYANT 


BUNN 
BUNN 
BUNN 
BUNN 
BUNN 
BUNN 
BUNN 
BUNN 
BUNN 


rPrrryrrry>»y 


BUXTON 
BUATON 
BUXTON 
BUXTON 
BUATON 
BUXTON 
BUATON 


CARLSON 
CARLSON 
CARLSON 
CARLSON 
CARLSON 
CARLSON 
CARLSON 
CARLSON 
CARLSON 
CARLSON 


CARVER 
CARVER 
CARVER 
CARVER 
CARVER 
CARVER 
CARVER 
CARVER 
CARVER 


CELiA 
CELIA 
CELIA 
CELIA 
CELIA 
CELIA 
CELIA 
CELIA 
CELIA 
CELIA 


rrrrrrrvrrr 


CLANCY 
CLANCY 
CLANCY 
CLANCY 
CLANCY 
CLANCY 
CLANCY 
CLANCY 
CLANCY 
CLANCY 


CONROY 
CONROY 
CONROY 
CONROY 
CONROY 
CONROY 
CONROY 
CONROY 


CRAWFOR 
CRAWFOR 
CRAWFOR 
CRAWFOR 
CRAWFOR 


TTD OTOreOOFP OTOTOnNVVO”9 


YpaVoOrecTD VOUVOOOD VUUUIOBowOOD 


AANAINIAIANAYN 


YORU 


ls\icliclolla}\=ilejisi{o lila) 


o00000090 


fo jtalie iio lts) 


APPENDIX O: SAS DATA FILE 
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RUSSO B 40.00 5.02 5.39 5.06 5.48 5.02 1585.25 10.59 0.00 402.48 47.82 Usisr25 Vesna 190.32 Cy 7i?) 95.66 
RUSSO B 80.00 Sow Cy oie Sa Bera Seon 332.34 25.49 0.00 426.03 100.36 N32.34 244.37 164 37 4.60 97 83 
RUSSO 8B 120.00 4,62 4.69 4.63 4.71 4.62 513.31 37.46 0.00 487.54 187.99 Sisco) S2sar4'5 173.45 4.50 100.00 | 
RUSSO 8 160.00 4.59 4.65 4.60 4.66 4.59 693.33 46.19 0.00 5$2.41 219.90 693.33 328.05 168.05 4.50 100.00 | 
RUSSO 8 200.00 5.59 6.19 5.64 6.41 5.59 884.04 55.63 0.00 $90.79 289.34 884.04 319.13 NUE), 12! 4.99 97.60 
RUSSO & 240.00 6 56 10.90 6.68 29.21 6.32 1099.76 68.03 0.00 606.09 373.86 1099.76 311.44 71.54 5.73 96. 77m 
RUSSO B 280.00 Tasll 5.48 tat \ph 5.69 6.90 1342 45 83.37 0.00 609.69 4685.81 1342.45 311.86 31.86 ode 97.50 
RUSSO 5& 320.00 28.85 6.61 Snore. 6.62 24.10 V60sos 98.38 92.10 610.00 609 92 TOSS soa lid 0.14 6.67 98.75 \ 
SANDJOJO D 0.00 ate 3.47 Bat ba hn CF ache! 0.00 0.00 0.00 396.50 0.00 0.00 320.00 320.00 3.47 100.00 
SANDJOJO 0 40.00 3.50 a} Eyl) ae SO 3.50 3.50 UE) WE 9.69 0.00 402.31 44.65 3 Ol) deg 510 2750 3.50 99.93 
SANDJOJO D 80.00 4.55 4.55 4.55 4.55 4.55 310.84 23.79 0.00 424.00 94.19 310.84 266.45 186.45 4.49 97.96 ‘ 
SANDJOJO © 120.00 5 66 salt Sribw 5 68 5.66 $21.84 37.92 0.00 481.45 1$8.43 $21.84 256.94 136.94 5.49 98.26 ; 
SANDJOJO DBD 160.00 ae 4.36 4.36 4 36 4 35 704 33 CVF} Gh. 0.00 550.68 PRC) ae) moa. 3) 3a 5 171.95 428 100.00 
SANDIOJO D 200.00 4 B2 4pee 4.82 4 83 4.82 890 45 56.62 0.00 §90.21 PRL PAE) 890 45 334.29 134.29 4 76 99 08 
SANDJUOJO D 240.00 5.60 5.60 5.60 5.61 5.60 1106.93 69.05 0.00 605.91 See 1106.93 320 40 80.40 5.59 98.59 
SANDJOJO D 280.00 5.90 5.90 5.90 5.90 5.90 1340.17 84.08 0.00 609 67 484.87 1340.17 316.80 36.80 5.90 99.48 
SANDJOJO D 320.00 2005 6.09 6.09 6.26 1) ce) 1592.31 5B 46 92.94 610.00 609.92 US923 1) az20r f Oneic 6.41 99.24 
SHADLE A 0.00 a CM 3.47 3.47 3.47 3547 0.00 0.00 0.00 396.50 0.00 0.00 320.00 320.00 3.47 100 00 
SHADLE A 40.00 3.50 S50 3510 ho EST the ES) 139.17 S765 0.00 402.30 44.49 13S 17 slv77e4 277.64 3.49 99 70 
SHADLE A 80 00 4.56 482 4.82 oa 4.52 289 47 22.39 0.00 423 44 87.43 289.47 270.32 190.32 03g 
SHADLE A 120.00 Seles S53. Si. 53 U oeaal 4.96 459.61 ey As 0.00 469.36 134.65 459.61 277.68 157.68 4 48 86 25 
SHADLE A 160.00 4.60 4.66 4.66 4.87 4.58 638.96 43.99 0.00 $32.11 187.84 S38 96 Sse oi 167.91 4.49 dal 2 
SHADLE A 200.90 4 87 5.04 5.04 6.25 4.83 821.64 53.29 0.00 577.62 247.83 821.84 340.48 140.48 4 64 92 §1 
SHADLE A 240 00 5.86 ell6 P26 ace Bo H3 1019.89 64.23 0.00 600.81 317.59 1019.89 329.99 89.99 Sree 87.62 
SHADLE A 360.00 Lidia 5.64 5.64 5.68 12.56 1685 .02 99.17 65.78 610.00 609.85 168$.02 360.56 0.56 ile: 93 84 
SHADLE A 363.00 2209 96 a UP? Smee Sc OseeleL a ght call: 100.00 100.00 610.00 609.91 1702.18 362.99 0.00 5.72 94 01 
SHITH C 0.00 Yo thy 3.47 347 aie 3.47 0.00 0.00 0.00 396.50 0.00 0.00 320.00 320.00 3. 47 Se 0 20g 
SMITH C 40.00 A) Bie 3.50 3.50 3.50 3.50 139.75 9 69 0.00 402.30 44.52 1392 7S) ee ohla 5.0 277 $0 an Se 99.46 
SMITH C 80.00 404 4.04 4.06 4.06 404 295.29 22.84 0.00 423.51 87.96 295.29 293.3€ 213.36 3.99 91.31 
SHITH ¢ 120.00 4.09 4.09 4.13 4.14 4.09 455.24 34.24 0.00 469.88 134.59 455.24 319.15 199.15 4.00 94.65 
SMITH C 160.00 Se 11 SeeliZ §.19 Sail Eye a al 646.33 44.17 0.00 LRP yl 188.83 646.33 309.86 149.86 4.99 83.96 
SMITH C 200 00 5.07 2) toh 5p 3 5.15 Cy ately! 846.24 54.69 0.00 578.10 aeyol os SMS 846.24 330.13 22100) het] 5.00 90.17 
SMITH © 240.00 la es Sri 5.05 joy S02 1046.24 66.09 0.00 601.25 324.52 1046.2¢ 339.53 S387 53 5.00 94.04 
SHITH © 280.00 6.00 6.01 5,95 Sak) t 6.00 ees Ne 80.52 0.00 608.68 418.94 Teves aleande 44.77 5.99 85.79 
SMITH C 320.00 6.38 6.76 5.83 5.86 6a ESS? BAe) 91.95 0.47 609 98 591.54 1517.24 338.09 18.09 6.00 91 29 
SPEGELE A 0.00 3 Gy 3 47 sean ta cha 3.47 0.00 0.00 0.00 396.50 0.00 0.00 320.00 320.00 3.47 100.00 
SPEGELE A 40.00 5 0. S39 5.39 6.39 4.97 SLSSES PS 10.59 0.00 402.36 45.66 OS Sie Sie On oe 190.32 4.22 86 43 
SPEGELE A 80.00 5.06 he 5238 6.36 4.97 332-34 25 0 0.00 424 21 92.05 332.34 243.18 163 18 4.60 86.10 9 
SFEGELE A 120.00 5.66 Gry? 6.17 elo Be 5.33 525.96 39.04 0.00 476.33 144.72 §25 96 253.06 is) gto 5.04 85.62 
SPEGELE A 160.00 $.63 5.99 5.99 43.99 5.40 Val. OS §0.15 0.00 541.66 205.68 2 ao) eegieplen 1:5) Poles §.26 86.338 9 
SPEGELE A 200.00 (Sola! 8.79 8.79 4.26 $.94 956.25 62.05 0.00 585.26 278.06 95:6 25 2833 81.33 Sei 85.80 
SPEGELE A 240.00 rae!) 4.34 4.34 6.01 6.50 1203.07 76.63 0.00 604 63 370.32 1203.07 285.30 45.30 6.42 85.53 
SPEGELE A 280.00 8 66 5.62 Bow 6.28 Pos) 1466.07 88.72 0.00 609.65 $42.43 1466.07 301.31 Pils tl 6.70 88.37 
SPEGELE A 320.00 17.68 6.75 6.75 6.80 15.38 1737.36 98.90 83.38 610.00 609.86 1737.36 H20553 0.53 6.85 91.48 
SPEGELE A 2 O00 eSneels 6.82 6.82 6 84 414.66 iS e 100.00 100.00 610.00 609.92 1787.92 323.00 0.00 6.86 91.69 
STEWAPT © 0.00 3.47 Nerain 3.47 3.47 3 47 0.00 0.00 0.00 396.50 0.00 0.00 320.00 320.00 3 47 100.00 
STEWAPT C 40.00 Small: SPO S20 S201 Ly oil 186.39 12.69 0.00 403.01 54 78 186.39 225.00 185.00 4.98 97.19 
STEWART 0 80.00 To IS 7.18 Bs hts To ehy Baus 448 43 33.24 0.00 436.29 129.32 448.43 183.87 TOS 837 6.98 97.29 
STEWART 0D 120.00 3.60 3.60 3.60 3.60 3 60 622.65 44.77 0.00 517.30 182.69 G22 705) eeseorel 1 209.11 3.56 100.00 
STEWART 0 160.00 4.06 4.07 4.07 4 07 4.06 TAS = eft, oil 5 Syil 0.00 570.84 236.31 778.70 334 71 phat Fl 4.00 98.98 | 
STEWAPT D 240.00 Syq Ste, 2) 5 ENG, &) Eile S50) yn bole 1193.19 75.35 0.00 607.91 400.12 1193.19 303.89 63.89 5.50 99.41 
STEWART C 280.00 5.50 5 50 5.50 5.50 5.50 1413.16 89.87 0.00 609.91 538.98 1413.16 303.90 23.90 Oyo Biel 99 97 
STEWART D 313.00 1639.85 5.89 5.89 5.94 1197.97 1606 76 100.00 100.00 610.00 609.91 1606.76 313.00 0.00 5.99 98.75 
SUHADI & 0.00 3.47 3.47 3.47 3°47 3.47 0.00 0.00 0.00 396.50 0.00 0.00 320.00 320.00 3.47 100 00 | 
SUHAD1 6 40.00 3.50 3.50 S510 eS i1 3.50 139247 9.65 0.00 402.30 44.53 P39 217 ~~ savie4 277864 3.49 99 90 
SUHADI B 80.00 zt | a4 3.33 3.34 Saas 273.00 21.44 0.00 423.26 84.74 tet ote) SiC\ gz! 26S ee 3.30 100.00 
SUHALDI & 20.00 Aor: 4 82 4.54 4.90 4 51 416.88 Woh cyy 0.00 465.15 128.75 416 88 307.37 162537 3.84 96.58 
SUHAD1 F& 160.00 4 99 4.16 4.10 417 4.09 $72.14 39 61 0.00 Meabia eas 179 41 §72.14 364 $4 204.54 Sroi2 99.39 
SUHAD1 5B 200.00 5.09 5.51 5.13 5.62 5.09 740.43 47.65 0.00 ith ea 237.39 740.43 352.38 152.38 4.45 97.07 
SUHAD!I B 240.00 Gele 10.24 7.29 73 < Vo 6 92 945.62 SB 0.00 598.79 soll AGS SAS 62 sz. 56 87.58 5.69 94.55 | 
SUHAD1 65 280.00 6.01 atte) 6.04 2.44 5.98 1176.60 edad 0.00 608.11 404 89 1176.60 345.69 65.69 5.84 99 19 
SUHAD1 B 320.00 6.58 5.90 6.84 Bynes) 6.49 1417.33 88.16 0.00 609.92 §34.42 Vales 849546 23.46 6 16 98 70 | 
SWANSON C 0.00 eas, 4? 3 47 3.47 thy 0.00 0.00 0.00 396.50 0.00 0.00 320.00 320.00 3 47 100.00 
SWANSON C 4c .Q0 5.00 5.00 5.01 By lala 5.00 186.39 ahd ake, 0.00 402.59 48.29 186.39 224 91 184 91 4.98 79.43 
SWANSON C 60.00 13.29 13.39 12.18 12.41 12.94 634.99 AYES a} 3! 0.00 431 84 2 Sree 634.99 120.00 40.00 12.92 53250 
SWANSON C 120.00 1S. 47 Sees eZ oS V2e 20 13.00 1154.25 83.01 0.00 Seles 276.06 S425 Lee o7 8.67 “300 fal Gr 
SWANSON C 160.90 Oe 73 1.02 9.36 oS. 10.06 1$83.74 84 96 0.00 603.41 $16.95 1583.74 190.19 30.19 SVeros 97 87 
SWANSON C¢ 200 00 ANS 5 BIS 9.04 9.86 9.88 10.00 1984.22 97.93 Ve oe 610.00 609.89 1984.22 200.50 0.50 Toeog 99.03 
SWANSON C 20$.CO 1866.94 7.99 7.99 7.99 7.99 2029 29 100.00 100.00 610.00 609 97 2029 29 205.00 0.00 7.99 100.00 
SWEENEY D0 0.00 ray, Sal? Bai 3.47 3.47 0.00 0.00 0.00 396.50 0.00 0.00 320.00 320.00 3.47 100.00 
SWEENEY D0 40.00 3.50 3.50 at Bo) 3.50 3.$0 139.75 9 69 0.00 402 31 44 65 m9 75 317.50 277.50 3.50 99.93 
SWEENEY © 80.00 4 55 4 55 4.55 4.55 4 55 310.84 aT 0.00 424.00 94 19 310.84 266.45 186.45 4.49 97.96 
SWEENEY D 120.00 4 21 S21 4.21 4522 4 21 478.67 35.44 0.00 479.02 146.88 478.67 313.64 193.64 411 100.00 
SWEENEY D 160.00 4.39 4 40 4 40 4.40 4.39 648.94 43.88 0.00 543.38 204.03 648.94 340.87 180.87 4.30 99.59 
SWEENEY C 200.00 Veale 4.36 4.36 4.36 Va elt: 820.92 $2.36 0.00 585.04 266.28 B20R Ge soGdrec 164.22 4 30 99.98 
SWEENEY D 240.00 4 40 4 40 4.40 4.40 4 40 996.03 62.26 0.00 603.79 334.85 996 03 369.10 129 10 4 40 99.79 
SWEENEY 0D 280.00 4.60 4 60 4.60 4.60 4.60 1178.24 73.96 0.00 609.12 412.65 VB 24 63. hth gud 4.60 99.59 
SWEENEY 0D 329.00 10 83 9.99 9.99 10.14 alto). ral 1539.45 93.87 21 61 609.98 607.14 1839.45 322.70 2. 70 ors 94.90 
SWEENEY D 327.90 3367 43 Ome? Ole 10.27 2696.00 1611.26 100.00 100.00 610.00 609 95 1611.26 326.98 0.00 10 27 96.96 144 
SWETT 8 0.00 3.47 3.47 ova be that} aera 0.00 0.00 0.00 396.50 0.00 0.00 320.00 320.00 3.47 100.00 
SWETT B 40.00 3.75 3.80 3276 Eee 3.75 141.85 9.81 0 00 402.33 45.07 141 85 298.24 258 24 3.61 99.08 
SWETT & 80.00 3.79 3.83 3.79 3.84 3.79 287.68 22 40 0.00 CVA AY Ta 88.96 287.68 309.88 229.88 3.68 99.51 
SWETT B 120.00 3.84 3.88 3.84 3.89 3.84 435.54 yh, He) 0.00 471.08 35035 4515.54 “389023 Po 8) BV ey tak 99.75 
SWETT B 160.00 3.98 4 05 3.99 4.07 3.98 586.04 40.23 0.00 So. VS MESS 232! $86.04 370.57 200r 57 3.80 99 40 
SWETT B 200.00 4 57 4.80 4.$9 4,86 eS 745.66 47.81 0.00 576.95 240.90 745 66 370.89 170.89 4.14 97.97 
SWETT 8 240.00 4.52 4.66 4.$3 4.70 4.52 915.22 56.93 0.00 599.97 304.36 OS 22 eso. 10 145.10 4 32 98 95 
SWETT B 2-80.00 Sue 5.66 5.06 6.01 4.99 1095.23 68.26 0.00 608.11 tit! otal 1095.23 374 74 94 74 4.65 96.21 
SWETT B 320.00 S255 2.48 5 65 Vy t/ 5 45 1290.34 80.67 0.00 609.85 465.43 W250 34 370/56 50.56 5.06 97 94 
SWETT & 360.00 5.59 Cy 5 ott) 6.29 5.20 Bo Bd 1497.60 93.98 1 Esty) 610.00 597.78 1497.60 373.09 13.09 5.28 98.95 
THERRIAU A 0.00 3.47 3.47 3.47 ai, 3.47 0.00 0.00 0.00 396.50 0.00 0 00 320.00 320 00 3.47 100.00 
THERRIAU A 40.00 3.50 3.50 3.50 Dyck el Biou 139.17 9.65 0.00 402.30 44.49 199.27 se 64 277.64 3 49 99.70 i 
THERRIAU A 60.00 a) Dial Bi S t) Ly aN okyyi 4253 276.75 21.79 0.00 423.38 86.53 278 75 328.55 248.55 3.49 99.66 
THERRIAU A 120.00 ta Zie! 9.60 9.60 Pe) a eat 5.82 456.04 33.64 0.00 468.19 133.96 456.04 231.98 111.98 5220 74 63 
THERRIAU A 1€0.00 2 62! 5.86 5.86 8.50 5.48 667.37 45.53 0.00 $31.64 190.50 667 37 ~291971 nlalal a Lal 55 82.98 
THERRIAU A 200.00 4.56 4 60 4 60 4.84 4.55 S5Sern2 58 76 0.00 578.34 254 34 G55) 72 Sia s0 141.80 4.51 100.00 
THERRIAU A 240.00 3S 6.69 6.69 aye ay 5.44 1046.84 66.33 0.00 (teal = Cys) BVPI gel 1046.84 329.33 69.33 5.00 92.61 
THERRIAL A 2890.00 so bie! rel thas §.02 §.47 ese 05 79.50 0.00 608.75 417.01 L2se 05 open oe 2.62 5.24 2. 13 | 
THERRIAV A 320.00 9 ol Sree 5.87 6.42 9.06 1496.63 89.83 0.00 609.98 574.09 1496.63 335.37 WES be 6.83 78.48 
THERRIAU A 355.00 3061.03 tn Sie Ve Siz, HaGsy PICO) Ne 1749.75 100.00 100.00 610 00 609.87 1749.75 384 97 0.00 7.57 79. 72 
TILLERY B 0.00 Wet Vas aes 3.47 Nothy 3.47 0.00 0.00 0.00 396 $0 0.00 0.00 320.00 320.00 3.47 100.00 @ 
TILLEPY 8 40.00 4.51 i a). 4.54 NU 4.51 149.89 10.28 0.00 402.42 46.72 149.89 252.96 212.96 39 96.90 @ 
Tab vEey ae: 60.00 6253 Was 6.63 8.16 6.53 334 84 25.40 0.00 425.43 100.28 334,84 206.99 126.99 5.16 ° 94 29 7m 
TILLERY 8 120.00 8.77 ahah UL: 9.02 17.90 8.38 $75 90 40.94 0.00 490.15 eho tt) 575.90 204.39 84.39 6.74 94 10 
TILLERY B 160.00 8.69 15.61 8.86 S703 8.13 863.28 56.02 0.00 562.79 2nOerae 863.28 229.88 69.88 Wo BiG) 7.19 
TILLERY 8 200.00 9.46 6.44 9.81 7.00 8.44 1182 95 Tay oval 0 00 600.44 393.99 1182.95 237.99 3799 8 35 97/555 
TILLERY 8 240.00 9 7) 8.60 9.91 8.61 8.67 1524.06 94.30 15.79 609.79 605.84 1524.06 243.76 eS 8 67 99 03 
TILLERY & 249.00 29.98 ae 7.94 8.33 8.39 1600.69 97 57 90.02 609.97 609.90 1600.69 249 18 0.18 8.39 100.00 
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TSONGAS A 0 00 3.47 3.47 407 asics 3.47 0.00 0.00 0.00 396.50 0.00 000 320.00 320.00 $ 4? 100 00 1$4 
TSONGAS A 40.00 Sule bye oie) 5.39 6.39 4.97 GES 8 eS) 10.59 0.00 402.36 45 .6€ EG) 34 PERN), SUA VOOR 32 auae Be 4. ashe 
TSONGAS A 80.00 4955 4.64 4.64 4.92 4.53 326.98 Otol 0.00 424.1? 91 Siz 326 96 262.60 182 40 4 3¢ 89 Ge 2k 
TSONGAS A 120 00 4 40 4 46 4 46 4.62 4.39 499.$2 37 43 0.00 475.12 141.66 499.52 296 a6 176.8¢C 4 36 34 «43 z§3 
TSONGAS A 160.00 4.08 E| alr. 4.12 4.23 4.06 662.48 45.80 0.00 Side 71 195.55 662 48 345 12 195 12 400 190 06 as 
TSONGAS A 200.00 wae eres ere) Sew ah ae 798.39 SPA leis 0.00 581.06 243.30 798.39 418,89 218.89 S200 00 203 
TSONGAS A 240.00 2.80 2.680 2.80 Pet, 2.80 914.46 59.10 0.00 600.98 287.52 914 46 461.31 PAPEGN 5 bY9l 2.81 100.00 250 
TSONGAS A 280.00 ai 4:1 J63 Hes 4 61 te ee 1033.09 66.80 0.00 607.95 336.12 1033.09 626.93 146.93 3} alfs) 92 43 2a 

TSONGAS A 320.00 4.03 4.97 4.97 1.98 ane 1166.62 841 0.00 609.69 394.27 1166 62 411.29 91.29 3 $4 86.63 219 
TSONGAS A 360.00 4.64 8.34 8.34 PL ates 4.46 abatal ev te) 3 82.05 0.00 609.98 480.02 1313.07 434 13 74.13 3.76 87.78 177 
TSONGAS A 400.00 4.25 0.50 0.50 Sy 7} 4.20 1468.27 85.71 0.00 610.00 536.988 1468.27 455.62 ee -P4 3.98 98.988 204 
TSONGAS A 440.00 4.23 4.02 4.02 4.06 4.20 1629.71 94 95 6.42 610.00 599.65 1629.71 458.38 aU} 6 SE) 4.09 51 40 163 
TSONGAS A 466.00 Paal gl 4.10 4.10 (Fe shal Alt) o 733 1736.48 100.00 100.00 610 00 609.85 1736 468 466.09 0.09 fy 93.02 163 
TUTT A 0.00 3.47 aa? 3.47 3.47 3.47 0.00 0.00 0.00 396.50 0.00 0 CO 3.0000 RY ien 9} °) 3.47 100.00 124 
TUTT A 40.00 cya felal 4 10 4.10 4.28 4.01 144.53 9.96 0.00 S02 32 44.85 EY CyB At) beefs Oe 6 AS Ve thet 94 70 Pedi 
Ur A 80.00 4.04 411 | ala 4.28 4.04 296.61 23.06 0.00 423.63 898.24 296.61 292 96 ole 96 3.96 94.2 190 
TUTT A 120.00 4.09 4.16 4.16 4.34 4.09 652.55 34.06 0.00 470.18 134.61 Versa eby | thee) [ool OG aul 3.93 95°27 259 
TUTT A 160.00 b.70 8.33 8.33 37.19 5.68 637.26 43.44 0.00 Sacer 187.90 637.26 275 65 Sea 5.18 WY 5 Pale 283 
TUTT A 200.00 6.63 7.90 7.90 ed 6.12 858.72 55.00 0.00 577.87 251.98 858 72 297 87 97.37 5 83 80.36 Paya 
TUTT A 240.00 4 $2 4 51 4 51 4.57 4.$2 Eyal o WE: 66.64 0.00 (yllal 5 7ae 324.92 TOS) 7 Saeeoa oe oe 109.7 4.52 100.00 937 
TUTT A 280.00 4.50 4 50 4.50 4 50 4.50 1231.97 TG ey 0.00 608.66 410.11 isos SO). 19 70.19 450 100 00 246 
TUTT A 320.00 Serle Bog 3.58 4.24 5.00 1611.97 98.70 0.00 609.95 $41.36 ales eso. 7 3 35 73 450 100.00 150 
TUTT A 360.00 alti: 4.28 4.28 4.40 6.51 1891.96 96.01 36.76 610.00 608.43 1591.96 364 60 4 80 450 100 00 129 
TUTT A 388.00 S.73 2.59 2059 2.60 Seal 1680.83 99.84 94.03 610.00 609.90 1660.83 368.53 0.53 2.61 100 00 151 
VANNEDER C 0.00 3 47 3.47 Sas 3 4er a4 0.00 0.00 0.00 396.50 0.00 0.00 320.00 320.00 Bear JOC .00 128 
VANNEDER © 40.00 La kue, 3.50 3.50 3.56 3.50 139.75 9.69 0.00 402.30 44.52 139.78 317.50 ZTE 8 3510 99 46 305 
VANNEDER C 80.00 4 04 4.04 4.06 4.06 4.04 295.29 22.84 0.00 4i23 ron 67.96 298.29 293.36 21580 3.99 91 31 248 
VANNEDER C 120.00 Sele a ht 5.20 Sree Srvle 486.34 36.03 6 00 470.75 137.986 486.34 273.10 assy ole) 4.99 Size Pe 
VANNEDER © 240.00 8.61 8.68 8.43 8 44 8.49 1334.79 93.97 0.00 604.16 405.20 ae el ia ake | 22.34 6 49 80.07 2€9 
VANNEDER C 280.06 es Pan 8.66 Sou, 8.98 9.02 1690.28 94.31 18.38 609 96 606.05 1690.28 285.44 5.44 8.99 84 #2 154 
VANNEDER C 296.00 487.53 8 63 8.94 8 95 166.75 1852.24 100.00 100.00 610.00 609.93 LS ese y PAS) [alot (op ola 9 00 87 86 160 
WALSH C 0.00 3.47 3.47 3.47 oe a erays 0.00 0.00 0.00 396.50 0.00 0.00 320.00 320.00 3 47 100.00 Ba pa 
WALSH C 40.00 =) 5 (8) 5.20 Sere Se ozo 192.61 aah als) 0.00 402.64 48.87 192.61 216.61 176.61 5 18 ve (5a! $18 
WALSH ¢ 80 00 S.26 Lin at) Bi chal 5.32 a Zale 400.45 30.96 0.00 426.57 100.86 400.45 225 i 145.10 § 20 86.27 490 
WALSH © Yeo OO 3.69 3.69 UTP Dy Wes 3.69 560.18 42.34 0.00 4686.28 149.01 560.18 319 08 199.08 3 63 100.00 428 
WALSH © 160.00 4.18 4.18 4.22 4.24 4.18 719.96 49.39 0.00 546.39 199.47 719.96 326 94 166.94 4.10 92.24 495 
WALSH C 200.00 4.65 4 66 wozal 4.72 4 6S 899.46 59.16 0.00 584 39 257.67 899.46 326 7§£ 126 75 459 98 44 287 
WALSH C 240.00 4.60 4.60 4.61 ace 4.60 1083.41 HiOmz24 0.00 603.29 2rd 1083.41 333 09 93.09 4 0 92.93 eS 
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